00000001:02000400:0.0F:1786034206.504285:0:2958:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg356-server.virtnet: executing set_hostid 00000001:02000400:0.0:1786034232.159216:0:3183:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1786034234.810894:0:3245:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 403 MB/s 00000001:01000000:2.0:1786034235.061157:0:3245:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 547 MB/s 00000001:01000000:3.0F:1786034235.311955:0:3245:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4063 MB/s 00000020:02000000:0.0:1786034236.164252:0:3276:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.56_52_g55149c9 00000400:02000000:0.0:1786034237.229046:0:3291:0:(api-ni.c:2822:lnet_startup_lndni()) Added LNI 192.168.203.156@tcp [8/256/0/180] 00008000:02000000:0.0:1786034242.061119:0:3441:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1786034319.667553:0:5270:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1786034337.247785:0:5842:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1786034337.247790:0:5842:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1786034337.248172:0:5842:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000000c352ce5 00000080:02000400:3.0:1786034337.248183:0:5842:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1786034337.258524:0:5842:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1786034337.258536:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1786034337.258733:0:5842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000c082ab6c) 00000020:00000080:2.0:1786034337.258753:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1786034337.297334:0:5842:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1786034337.302116:0:5842:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1786034337.378115:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1786034337.378151:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786034337.378170:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1786034337.378218:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1786034337.378241:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1786034337.378745:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1786034337.378752:0:5842:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786034337.378761:0:5842:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x490975051af3f8a1 00000020:01000004:3.0:1786034337.378768:0:5842:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1786034337.378773:0:5842:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1786034337.378776:0:5842:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000c352ce5 from MGS 00000020:01000004:3.0:1786034337.378781:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1786034337.378801:0:5842:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000bb6f2915) 00000020:00000080:3.0:1786034337.378812:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1786034337.379188:0:5842:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000c352ce5 from MGS, refs=2 00080000:01000000:3.0:1786034337.379193:0:5842:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1786034337.379199:0:5842:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x490975051af3f8af 00000100:00100000:3.0:1786034337.379283:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1786034337.379392:0:5842:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1786034337.379397:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1786034337.380263:0:5842:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1786034337.380270:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1786034337.381262:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786034337.381383:0:5842:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1786034337.381388:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1786034337.382762:0:5842:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1786034337.382771:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1786034337.383412:0:5842:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1786034337.383418:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1786034337.391818:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034337.391842:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034337.391844:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034337.392415:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034337.392418:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034337.392419:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1786034337.393298:0:5842:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1786034337.396685:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1786034337.642897:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1743 MB/s 00000001:01000000:3.0:1786034337.893273:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2275 MB/s 00000001:01000000:0.0:1786034338.143894:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 314 MB/s 00000001:01000000:3.0:1786034338.394990:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 382 MB/s 00080000:10000000:3.0:1786034338.407012:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1786034338.416087:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1786034338.432212:0:5842:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1786034338.432240:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1786034338.432242:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1786034338.436012:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1786034338.436091:0:5842:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1786034338.436158:0:5842:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1786034338.436368:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1786034338.436393:0:5842:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1786034338.436708:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786034338.437041:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1786034338.437047:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1786034338.446125:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1786034338.446139:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1786034338.446437:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1786034338.446444:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1786034338.447156:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1786034338.447173:0:5842:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.156@tcp' 00000020:01000004:1.0:1786034338.447175:0:5842:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1786034338.447223:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.156@tcp (typ=mgc) 00000020:00000080:1.0:1786034338.447239:0:5842:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.156@tcp (00000000aafb2fb6) 00000020:00000080:1.0:1786034338.447254:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1786034338.447361:0:5842:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a2f4f237@MGC192.168.203.156@tcp: add connection 192.168.203.156@tcp at head 00010000:00010000:1.0:1786034338.447518:0:5842:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.156@tcp-0 is initialized 00000040:01000000:1.0:1786034338.447524:0:5842:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.156@tcp ctxt 1 is initialized 00000100:00080000:2.0:1786034338.448030:0:5857:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1786034338.448225:0:5858:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1786034338.448278:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.156@tcp (uuid 117a9d0c-602c-47bd-a536-8de3b3d11e1e) 00000020:00000080:2.0:1786034338.448291:0:5842:0:(genops.c:1406:class_connect()) connect: client 117a9d0c-602c-47bd-a536-8de3b3d11e1e, cookie 0x490975051af3f8bd 00000100:00080000:2.0:1786034338.448300:0:5842:0:(import.c:510:import_select_connection()) MGC192.168.203.156@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786034338.448304:0:5842:0:(import.c:624:import_select_connection()) MGC192.168.203.156@tcp: import 00000000a2f4f237 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:2.0:1786034338.448339:0:5842:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a60f3ad1 x1872792636096640/t0(0) o250->MGC192.168.203.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786034338.448364:0:5842:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 117a9d0c-602c-47bd-a536-8de3b3d11e1e->MGS 00000020:01000004:2.0:1786034338.448376:0:5842:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1786034338.448381:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1786034338.448389:0:5842:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000037e8ef53) 00000020:00000080:2.0:1786034338.448397:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1786034338.451079:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a60f3ad1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3306:1872792636096640:0@lo:250: 00000100:00100000:3.0:1786034338.453007:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034338.453113:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636096640 00000100:00100000:3.0:1786034338.453130:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636096640 00000100:00100000:3.0:1786034338.453156:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786034338.453161:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abe9a954 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1872792636096640:12345-0@lo:250: 00010000:00080000:3.0:1786034338.453185:0:5853:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 117a9d0c-602c-47bd-a536-8de3b3d11e1e@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:3.0:1786034338.453206:0:5853:0:(genops.c:1406:class_connect()) connect: client 117a9d0c-602c-47bd-a536-8de3b3d11e1e, cookie 0x490975051af3f8cb 00000100:00080000:3.0:1786034338.453345:0:5853:0:(import.c:65:import_set_state_nolock()) 000000000643e9f2 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786034338.453404:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abe9a954 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+5:3306:x1872792636096640:12345-0@lo:250: Request processed in 242us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034338.453412:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786034338.453459:0:3306:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.156@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1786034338.453467:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.156@tcp: connect to target with instance 0 00000100:00080000:3.0:1786034338.453474:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.156@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1786034338.453478:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1786034338.453481:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000a2f4f237 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1786034338.453483:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1786034338.453491:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1786034338.453495:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a60f3ad1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3306:1872792636096640:0@lo:250: 00000100:00100000:2.0:1786034338.486585:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786034338.486758:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1786034338.486764:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1786034338.492534:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1786034338.492549:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1786034338.492935:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1786034338.492942:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1786034338.498109:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786034338.498265:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1786034338.498270:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1786034338.502031:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1786034338.502042:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1786034338.589345:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786034338.589519:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1786034338.589525:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1786034338.598890:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1786034338.598906:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1786034338.600110:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786034338.600261:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1786034338.600267:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1786034338.603578:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1786034338.603588:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1786034338.618343:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786034338.618534:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1786034338.618541:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1786034338.620245:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1786034338.620254:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1786034338.620878:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786034338.621275:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1786034338.621280:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1786034338.630224:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1786034338.630239:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1786034338.685330:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786034338.685785:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1786034338.685798:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1786034338.690416:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1786034338.690439:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1786034338.691235:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1786034338.691242:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1786034338.693318:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1786034338.693339:0:5842:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1786034338.693344:0:5842:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.156@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1786034338.693490:0:5842:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.156@tcp ctxt 0 is initialized 00000020:01000004:1.0:1786034338.693520:0:5842:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.156@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1786034338.693538:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1786034338.693539:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786034338.693540:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786034338.693541:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786034338.693542:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786034338.693544:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786034338.693544:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786034338.693546:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786034338.693550:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786034338.693551:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786034338.693552:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786034338.693553:0:5842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1786034338.693554:0:5842:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1786034338.693556:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786034338.693557:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786034338.693558:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786034338.693559:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786034338.693560:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786034338.693561:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786034338.693562:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786034338.693562:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786034338.693563:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786034338.693564:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786034338.693565:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786034338.693566:0:5842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1786034338.693595:0:5842:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1786034338.693609:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e13d695 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636096768:0@lo:253: 00000100:00100000:1.0:1786034338.693671:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034338.693717:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 00000000101b6d98 going to sleep for 11 seconds 00000100:00100000:2.0:1786034338.694238:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636096768 00000100:00100000:2.0:1786034338.694245:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636096768 00000100:00100000:2.0:1786034338.694278:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786034338.694284:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fd64025 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+5:5842:x1872792636096768:12345-0@lo:253: 20000000:01000000:2.0:1786034338.694324:0:5856:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1786034338.694327:0:5856:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1786034338.708510:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1786034338.708594:0:5856:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1786034338.709008:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786034338.709995:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1786034338.711069:0:5856:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1786034338.711074:0:5856:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1786034338.711080:0:5856:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1786034338.711082:0:5856:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1786034338.711098:0:5856:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1786034338.711317:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786034338.711901:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1786034338.712459:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1786034338.712532:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1786034338.712605:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1786034338.712668:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1786034338.712794:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1786034338.712802:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1786034338.716610:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1786034338.716633:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1786034338.716674:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1786034338.716681:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1786034338.716707:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1786034338.716747:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1786034338.716803:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1786034338.716811:0:5856:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1786034338.717477:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786034338.717671:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1786034338.717683:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1786034338.717718:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1786034338.717752:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1786034338.717795:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1786034338.717806:0:5856:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1786034338.717908:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1786034338.718045:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1786034338.718094:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1786034338.718131:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1786034338.718165:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1786034338.718176:0:5856:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1786034338.718257:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1786034338.718265:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1786034338.718298:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1786034338.718331:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1786034338.719807:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1786034338.719890:0:5856:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1786034338.719897:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1786034338.721037:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1786034338.722104:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1786034338.726295:0:5856:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.156@tcp for mdt 20000000:01000000:1.0:1786034338.726300:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.156@tcp (null) (null) (null) 00000040:00080000:1.0:1786034338.727512:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1786034338.727525:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1786034338.727568:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1786034338.727575:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.156@tcp (null) (null) 00000040:00080000:1.0:1786034338.727639:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1786034338.727648:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1786034338.727675:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1786034338.727704:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1786034338.727800:0:5856:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1786034338.727803:0:5856:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1786034338.727809:0:5856:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1786034338.728330:0:5856:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1786034338.731531:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1786034338.731760:0:5856:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1786034338.743446:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1786034338.743506:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1786034338.743590:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1786034338.743613:0:5856:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1786034338.743615:0:5856:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1786034338.743618:0:5856:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1786034338.743629:0:5856:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1786034338.743631:0:5856:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1786034338.743666:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1786034338.743668:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1786034338.746361:0:5881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1786034338.746754:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1786034338.746799:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1786034338.746868:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1786034338.746881:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1786034338.746892:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1786034338.747464:0:5882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1786034338.747717:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1786034338.747764:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1786034338.747847:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1786034338.747862:0:5856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1786034338.747865:0:5856:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1786034338.747870:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786034338.747888:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000db35c072/0x490975051af3f8d2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034338.747903:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db35c072/0x490975051af3f8d2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034338.748057:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000db35c072/0x490975051af3f8d2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034338.748065:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000db35c072/0x490975051af3f8d2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034338.748071:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000db35c072/0x490975051af3f8d2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034338.748082:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000db35c072/0x490975051af3f8d2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034338.748087:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000db35c072 already unused, calling callback (00000000fb336b09) 00010000:00010000:1.0:1786034338.748090:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000db35c072/0x490975051af3f8d2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034338.748095:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000db35c072/0x490975051af3f8d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034338.748105:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000db35c072/0x490975051af3f8d2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034338.748231:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000db35c072/0x490975051af3f8d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034338.748235:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000db35c072/0x490975051af3f8d2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786034338.748251:0:5856:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1786034339.238332:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fd64025 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+5:5842:x1872792636096768:12345-0@lo:253: Request processed in 544041us (544654us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034339.238346:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786034339.243376:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e13d695 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636096768:0@lo:253: 10000000:01000000:1.0:1786034339.243697:0:5842:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1786034339.243701:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786034339.243703:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786034339.243704:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786034339.243705:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1786034339.243707:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786034339.243708:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786034339.243709:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786034339.243711:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786034339.243712:0:5842:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1786034339.243728:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786034339.243729:0:5842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1786034339.247339:0:5842:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000c352ce5 from lustre-MDT0000 10000000:01000000:2.0:1786034339.247374:0:5842:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1786034339.247377:0:5842:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1786034339.247381:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff964542f499c0 10000000:01000000:2.0:1786034339.247385:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786034339.247688:0:5842:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff964542f499c0 from 1 10000000:01000000:2.0:1786034339.247692:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786034339.247729:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: 00000000475da39e/0x490975051af3f8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034339.247742:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: 00000000475da39e/0x490975051af3f8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034339.247750:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: 00000000475da39e/0x490975051af3f8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034339.247767:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000025151f91 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636096896:0@lo:101: 00000100:00100000:2.0:1786034339.248325:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034339.248450:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 00000000484ffbfd going to sleep for 11 seconds 00000100:00100000:2.0:1786034339.258739:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636096896 00000100:00100000:2.0:1786034339.258754:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636096896 00000100:00100000:2.0:1786034339.259300:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786034339.259310:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ff7dccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+5:5842:x1872792636096896:12345-0@lo:101: 00010000:00010000:2.0:1786034339.259338:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034339.259357:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001377966f/0x490975051af3f8e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3f8d9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034339.259381:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001377966f/0x490975051af3f8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3f8d9 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034339.259400:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001377966f/0x490975051af3f8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f8d9 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034339.259409:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001377966f, rc 0) 00000100:00100000:2.0:1786034339.259482:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ff7dccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+6:5842:x1872792636096896:12345-0@lo:101: Request processed in 175us (11158us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034339.259489:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786034339.259568:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000025151f91 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636096896:0@lo:101: 00010000:00010000:0.0:1786034339.259583:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: 00000000475da39e/0x490975051af3f8d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f8e0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034339.259590:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: 00000000475da39e/0x490975051af3f8d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3f8e0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034339.259672:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636097024:0@lo:501: 00000100:00100000:0.0:1786034339.259714:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034339.266555:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 00000000df7ebb7e going to sleep for 11 seconds 00000100:00100000:3.0:1786034339.267138:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636097024 00000100:00100000:3.0:1786034339.267147:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636097024 00000100:00100000:3.0:1786034339.267193:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786034339.267215:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a39bb91a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+6:5842:x1872792636097024:12345-0@lo:501: 00000100:00100000:3.0:1786034339.267618:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a39bb91a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+6:5842:x1872792636097024:12345-0@lo:501: Request processed in 405us (7902us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786034339.267626:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786034339.270326:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636097024:0@lo:501: 10000000:01000000:0.0:1786034339.270361:0:5842:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1786034339.270373:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: 00000000475da39e/0x490975051af3f8d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f8e0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034339.270387:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: 00000000475da39e/0x490975051af3f8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f8e0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034339.270404:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff964559843800 10000000:01000000:0.0:1786034339.270411:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1786034339.270422:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff964559843800 10000000:01000000:0.0:1786034339.270425:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1786034339.270428:0:5842:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff964559843800 from 1 10000000:01000000:0.0:1786034339.270430:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1786034339.270460:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: 000000000c4f9101/0x490975051af3f8e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034339.270481:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: 000000000c4f9101/0x490975051af3f8e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034339.270491:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: 000000000c4f9101/0x490975051af3f8e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034339.270508:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636097152:0@lo:101: 00000100:00100000:0.0:1786034339.270554:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034339.270585:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 00000000df7ebb7e going to sleep for 11 seconds 00000100:00100000:3.0:1786034339.270738:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636097152 00000100:00100000:3.0:1786034339.270744:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636097152 00000100:00100000:3.0:1786034339.270771:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786034339.270777:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebb8f6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+6:5842:x1872792636097152:12345-0@lo:101: 00010000:00010000:3.0:1786034339.270787:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034339.270799:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000014a9b03e/0x490975051af3f8ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3f8e7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034339.270819:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000014a9b03e/0x490975051af3f8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3f8e7 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034339.270841:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000014a9b03e/0x490975051af3f8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f8e7 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034339.270848:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000014a9b03e, rc 0) 00000100:00100000:3.0:1786034339.270896:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebb8f6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+7:5842:x1872792636097152:12345-0@lo:101: Request processed in 119us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034339.270902:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786034339.272490:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636097152:0@lo:101: 00010000:00010000:0.0:1786034339.272506:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: 000000000c4f9101/0x490975051af3f8e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034339.272515:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: 000000000c4f9101/0x490975051af3f8e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034339.272530:0:5842:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1786034339.272545:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: 000000000c4f9101/0x490975051af3f8e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034339.272566:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: 000000000c4f9101/0x490975051af3f8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034339.272571:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1786034339.272575:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786034339.272580:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff964559843800 10000000:01000000:0.0:1786034339.272581:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1786034339.272584:0:5842:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1786034339.272595:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1786034339.272615:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: 00000000473988cd/0x490975051af3f8f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034339.272626:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: 00000000473988cd/0x490975051af3f8f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034339.272642:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: 00000000473988cd/0x490975051af3f8f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034339.272656:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636097280:0@lo:101: 00000100:00100000:0.0:1786034339.272712:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034339.272736:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 00000000df7ebb7e going to sleep for 11 seconds 00000100:00100000:3.0:1786034339.272919:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636097280 00000100:00100000:3.0:1786034339.272924:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636097280 00000100:00100000:3.0:1786034339.272950:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786034339.272955:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000792ca6bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+7:5842:x1872792636097280:12345-0@lo:101: 00010000:00010000:3.0:1786034339.272965:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034339.272975:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a7a474f/0x490975051af3f8fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3f8f5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034339.272995:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a7a474f/0x490975051af3f8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3f8f5 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034339.273003:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a7a474f/0x490975051af3f8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f8f5 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034339.273010:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a7a474f, rc 0) 00000100:00100000:3.0:1786034339.273048:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000792ca6bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+8:5842:x1872792636097280:12345-0@lo:101: Request processed in 93us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034339.273054:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786034339.276442:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636097280:0@lo:101: 00010000:00010000:0.0:1786034339.276466:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: 00000000473988cd/0x490975051af3f8f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f8fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034339.276477:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: 00000000473988cd/0x490975051af3f8f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3f8fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034339.276541:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636097408:0@lo:501: 00000100:00100000:0.0:1786034339.276585:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034339.276614:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 00000000df7ebb7e going to sleep for 11 seconds 00000100:00100000:3.0:1786034339.277242:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636097408 00000100:00100000:3.0:1786034339.277249:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636097408 00000100:00100000:3.0:1786034339.277278:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786034339.277283:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000095da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+8:5842:x1872792636097408:12345-0@lo:501: 00000100:00100000:3.0:1786034339.277518:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000095da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+9:5842:x1872792636097408:12345-0@lo:501: Request processed in 234us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034339.277525:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786034339.277642:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636097408:0@lo:501: 00000100:00100000:0.0:1786034339.277669:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636097536:0@lo:503: 00000100:00100000:0.0:1786034339.277700:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034339.277725:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 00000000df7ebb7e going to sleep for 11 seconds 00000100:00100000:3.0:1786034339.277809:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636097536 00000100:00100000:3.0:1786034339.277813:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636097536 00000100:00100000:3.0:1786034339.277841:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786034339.277846:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000667de2ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+9:5842:x1872792636097536:12345-0@lo:503: 00000100:00100000:3.0:1786034339.277976:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000667de2ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+9:5842:x1872792636097536:12345-0@lo:503: Request processed in 130us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034339.277982:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786034339.281340:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636097536:0@lo:503: 00000100:00100000:0.0:1786034339.282016:0:5884:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5884:1872792636097664:0@lo:502: 00000100:00100000:0.0:1786034339.282083:0:5884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034339.282139:0:5884:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b15d9dc3 going to sleep for 11 seconds 00000100:00100000:3.0:1786034339.282322:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636097664 00000100:00100000:3.0:1786034339.282328:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636097664 00000100:00100000:3.0:1786034339.282374:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786034339.282387:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025c1e02e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+9:5884:x1872792636097664:12345-0@lo:502: 00000100:00100000:3.0:1786034339.282628:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025c1e02e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+9:5884:x1872792636097664:12345-0@lo:502: Request processed in 241us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034339.282745:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786034339.282981:0:5884:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5884:1872792636097664:0@lo:502: 00000020:01000000:0.0:1786034339.283009:0:5884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786034339.283019:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034339.283022:0:5884:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1786034339.283026:0:5884:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1786034339.283029:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786034339.283049:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000017f6c8bb) 00000020:00000080:0.0:1786034339.283067:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1786034339.283073:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1786034339.283536:0:5884:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1786034339.283544:0:5884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x490975051af3f90a 00000020:00000080:0.0:1786034339.283814:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1786034339.283818:0:5884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034339.283843:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034339.283845:0:5884:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1786034339.283848:0:5884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786034339.283852:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034339.283854:0:5884:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1786034339.283857:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786034339.283862:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004656f668) 00000020:00000080:0.0:1786034339.283871:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1786034339.283875:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1786034339.283877:0:5884:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1786034339.283879:0:5884:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1786034339.283885:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1786034339.283924:0:5884:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000c352ce5 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1786034339.283937:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000b2e5560) 00000020:00000080:0.0:1786034339.283943:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1786034339.283998:0:5884:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1786034339.284003:0:5884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x490975051af3f91f 00000020:00000080:0.0:1786034339.284093:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1786034339.284099:0:5884:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1786034339.284104:0:5884:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x490975051af3f926 00080000:01000000:0.0:1786034339.284694:0:5884:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1786034339.284704:0:5884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x490975051af3f92d 00080000:10000000:0.0:1786034339.286277:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1786034339.286810:0:5884:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1786034339.299753:0:5884:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1786034339.440715:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034339.505096:0:5884:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1786034339.507311:0:5884:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1786034339.521625:0:5884:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1786034339.522071:0:5884:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1786034339.681391:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000de619519) 00000020:00000080:3.0:1786034339.681420:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1786034339.681490:0:5884:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1786034339.681496:0:5884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x490975051af3f93b 00000020:00000080:0.0:1786034339.682351:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1786034339.685955:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1786034339.816266:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1786034339.879095:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1786034339.973372:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1786034340.119378:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1786034340.327443:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:1.0:1786034340.471904:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786034340.483199:0:5884:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x490975051af3f942 00000020:00000080:0.0:1786034340.485640:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1786034340.485654:0:5884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034340.485662:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034340.485664:0:5884:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1786034340.485668:0:5884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786034340.485674:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034340.485676:0:5884:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1786034340.485679:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1786034340.485719:0:5884:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1786034340.485731:0:5884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034340.485734:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034340.485736:0:5884:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1786034340.485738:0:5884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786034340.485740:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034340.485741:0:5884:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786034340.485744:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786034340.485745:0:5884:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1786034340.485787:0:5884:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5884:1872792636097792:0@lo:502: 00000100:00100000:0.0:1786034340.485890:0:5884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034340.485974:0:5884:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cf36d0a1 going to sleep for 11 seconds 00000100:00100000:1.0:1786034340.486121:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636097792 00000100:00100000:1.0:1786034340.486128:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636097792 00000100:00100000:1.0:1786034340.486172:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786034340.486180:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079723608 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+9:5884:x1872792636097792:12345-0@lo:502: 00000100:00100000:1.0:1786034340.486729:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079723608 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+9:5884:x1872792636097792:12345-0@lo:502: Request processed in 549us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034340.486737:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1786034340.487522:0:5884:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5884:1872792636097792:0@lo:502: 00000020:01000000:0.0:1786034340.487550:0:5884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034340.487571:0:5884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034340.487572:0:5884:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:0.0:1786034340.487576:0:5884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1786034340.487712:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1786034340.487728:0:5842:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1786034340.487748:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: 00000000473988cd/0x490975051af3f8f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f8fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.487758:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: 00000000473988cd/0x490975051af3f8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f8fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786034340.487765:0:5842:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff964559843800 from 1 10000000:01000000:2.0:1786034340.487768:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1786034340.487793:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.487811:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.487819:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034340.487864:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e7cb5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636097920:0@lo:101: 00000100:00100000:2.0:1786034340.487896:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034340.487918:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 0000000029557e85 going to sleep for 11 seconds 00000100:00100000:1.0:1786034340.488497:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636097920 00000100:00100000:1.0:1786034340.488503:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636097920 00000100:00100000:1.0:1786034340.488534:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786034340.488540:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd014b93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+9:5842:x1872792636097920:12345-0@lo:101: 00010000:00010000:1.0:1786034340.488551:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034340.488563:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db35c072/0x490975051af3f950 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3f949 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034340.488582:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db35c072/0x490975051af3f950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3f949 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034340.488595:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db35c072/0x490975051af3f950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f949 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034340.488603:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db35c072, rc 0) 00000100:00100000:1.0:1786034340.488707:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd014b93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+10:5842:x1872792636097920:12345-0@lo:101: Request processed in 167us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034340.488713:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786034340.488862:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e7cb5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636097920:0@lo:101: 00010000:00010000:0.0:1786034340.488874:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f950 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034340.488882:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3f950 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034340.489396:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636098048:0@lo:256: 00000100:00100000:0.0:1786034340.490534:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034340.490577:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cf36d0a1 going to sleep for 11 seconds 00000100:00100000:1.0:1786034340.491611:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636098048 00000100:00100000:1.0:1786034340.491629:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636098048 00000100:00100000:1.0:1786034340.491683:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786034340.491691:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f107c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+10:5842:x1872792636098048:12345-0@lo:256: 20000000:01000000:1.0:1786034340.491714:0:5853:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1786034340.491719:0:5853:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1786034340.491811:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f107c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+10:5842:x1872792636098048:12345-0@lo:256: Request processed in 121us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034340.491819:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786034340.492156:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636098048:0@lo:256: 10000000:01000000:0.0:1786034340.493253:0:5842:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786034340.493307:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f950 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034340.493318:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f950 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034340.493325:0:5842:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff964559843800 from 1 10000000:01000000:0.0:1786034340.493327:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786034340.493357:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034340.493375:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034340.493384:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034340.493402:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636098176:0@lo:101: 00000100:00100000:0.0:1786034340.494555:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034340.494592:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cf36d0a1 going to sleep for 11 seconds 00000100:00100000:2.0:1786034340.496547:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636098176 00000100:00100000:2.0:1786034340.496557:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636098176 00000100:00100000:2.0:1786034340.496601:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786034340.496607:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009aab341f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+10:5842:x1872792636098176:12345-0@lo:101: 00010000:00010000:2.0:1786034340.496632:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034340.496648:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000041bd66ad/0x490975051af3f95e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3f957 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.496674:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041bd66ad/0x490975051af3f95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3f957 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.496682:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000041bd66ad/0x490975051af3f95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f957 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.496689:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000041bd66ad, rc 0) 00000100:00100000:2.0:1786034340.496749:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009aab341f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:5842:x1872792636098176:12345-0@lo:101: Request processed in 141us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034340.496754:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1786034340.497612:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636098176:0@lo:101: 00010000:00010000:0.0:1786034340.497636:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f95e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034340.497659:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3f95e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034340.497713:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636098304:0@lo:501: 00000100:00100000:0.0:1786034340.497754:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034340.497785:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cf36d0a1 going to sleep for 11 seconds 00000100:00100000:2.0:1786034340.497936:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636098304 00000100:00100000:2.0:1786034340.497951:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636098304 00000100:00100000:2.0:1786034340.497977:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786034340.497981:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d364c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:5842:x1872792636098304:12345-0@lo:501: 00000100:00100000:2.0:1786034340.498530:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d364c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:5842:x1872792636098304:12345-0@lo:501: Request processed in 548us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034340.498537:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786034340.498646:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099e7ff76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636098304:0@lo:501: 00000100:00100000:1.0:1786034340.498675:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e13d695 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636098432:0@lo:503: 00000100:00100000:1.0:1786034340.498715:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034340.498741:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b8b288a7 going to sleep for 11 seconds 00000100:00100000:0.0:1786034340.499021:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636098432 00000100:00100000:0.0:1786034340.499026:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636098432 00000100:00100000:0.0:1786034340.499051:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786034340.499058:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce32f105 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:5842:x1872792636098432:12345-0@lo:503: 00000040:00080000:0.0:1786034340.499091:0:5855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786034340.499128:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce32f105 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:5842:x1872792636098432:12345-0@lo:503: Request processed in 71us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034340.499135:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786034340.500544:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e13d695 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636098432:0@lo:503: 00000040:00080000:1.0:1786034340.502146:0:5889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1786034340.502383:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1786034340.502401:0:5842:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786034340.508753:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f95e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.508770:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f95e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786034340.508861:0:5842:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1786034340.508864:0:5842:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff964559843800 10000000:01000000:2.0:1786034340.508867:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff964559843800 10000000:01000000:2.0:1786034340.508871:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786034340.508877:0:5842:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff964559843800 from 1 10000000:01000000:2.0:1786034340.508880:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786034340.508914:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: 00000000748c167a/0x490975051af3f965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.508922:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: 00000000748c167a/0x490975051af3f965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.508932:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: 00000000748c167a/0x490975051af3f965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034340.508954:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000edfa4c0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636098560:0@lo:101: 00000100:00100000:2.0:1786034340.509031:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034340.509078:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 0000000029557e85 going to sleep for 11 seconds 00000100:00100000:1.0:1786034340.509165:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636098560 00000100:00100000:1.0:1786034340.509172:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636098560 00000100:00100000:1.0:1786034340.509216:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786034340.509224:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c20e6d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:5842:x1872792636098560:12345-0@lo:101: 00010000:00010000:1.0:1786034340.509237:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034340.509247:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c4130e9f/0x490975051af3f96c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3f965 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034340.509266:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4130e9f/0x490975051af3f96c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3f965 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034340.509274:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c4130e9f/0x490975051af3f96c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f965 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034340.509292:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c4130e9f, rc 0) 00000100:00100000:1.0:1786034340.509324:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c20e6d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5842:x1872792636098560:12345-0@lo:101: Request processed in 101us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034340.509330:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786034340.509703:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000edfa4c0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636098560:0@lo:101: 00010000:00010000:2.0:1786034340.509716:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: 00000000748c167a/0x490975051af3f965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f96c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.509724:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: 00000000748c167a/0x490975051af3f965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3f96c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034340.509766:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000edfa4c0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636098688:0@lo:501: 00000100:00100000:2.0:1786034340.509786:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034340.509861:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 0000000029557e85 going to sleep for 11 seconds 00000100:00100000:1.0:1786034340.514548:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636098688 00000100:00100000:1.0:1786034340.514561:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636098688 00000100:00100000:2.0:1786034340.520519:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786034340.520533:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d40681c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5842:x1872792636098688:12345-0@lo:501: 00000100:00100000:3.0:1786034340.520985:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000edfa4c0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636098688:0@lo:501: 00000100:00100000:3.0:1786034340.521048:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a325552e pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636098816:0@lo:503: 00000100:00100000:3.0:1786034340.526868:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034340.526918:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b95c01ba going to sleep for 11 seconds 00000100:00100000:2.0:1786034340.526981:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d40681c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5842:x1872792636098688:12345-0@lo:501: Request processed in 6450us (17193us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034340.526991:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786034340.527026:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636098816 00000100:00100000:2.0:1786034340.527032:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636098816 00000100:00100000:2.0:1786034340.527131:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786034340.527138:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052af4e9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5842:x1872792636098816:12345-0@lo:503: 00000100:00100000:2.0:1786034340.527577:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052af4e9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5842:x1872792636098816:12345-0@lo:503: Request processed in 439us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034340.527584:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786034340.527657:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a325552e pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636098816:0@lo:503: 00000100:00100000:3.0:1786034340.535053:0:5890:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a325552e pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5890:1872792636098944:0@lo:502: 00000100:00100000:3.0:1786034340.535131:0:5890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034340.535172:0:5890:0:(client.c:2702:ptlrpc_set_wait()) set 00000000415bca89 going to sleep for 11 seconds 00000100:00100000:1.0:1786034340.535217:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636098944 00000100:00100000:1.0:1786034340.535223:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636098944 00000100:00100000:1.0:1786034340.535262:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786034340.535269:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f33bccc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5890:x1872792636098944:12345-0@lo:502: 00000100:00100000:1.0:1786034340.535540:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f33bccc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5890:x1872792636098944:12345-0@lo:502: Request processed in 270us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034340.535547:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786034340.535713:0:5890:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a325552e pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5890:1872792636098944:0@lo:502: 00000020:01000004:3.0:1786034340.535769:0:5890:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1786034340.535782:0:5890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006af915cd) 00000020:00000080:3.0:1786034340.535811:0:5890:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1786034340.536022:0:5890:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000c352ce5 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786034340.536034:0:5890:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000c352ce5 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786034340.536036:0:5890:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000c352ce5 4 00010000:00080000:3.0:1786034340.536063:0:5890:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d56ef3fe@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.156@tcp at head 00010000:00010000:3.0:1786034340.541019:0:5890:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1786034340.541114:0:5890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1786034340.541144:0:5890:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786034340.541154:0:5890:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x490975051af3f97a 00000100:00080000:3.0:1786034340.541163:0:5890:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786034340.541167:0:5890:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d56ef3fe using connection 192.168.203.156@tcp/0@lo 00000100:00100000:3.0:1786034340.541197:0:5890:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a325552e x1872792636099072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786034340.541215:0:5890:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1786034340.541470:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a325552e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872792636099072:0@lo:38: 00000100:00100000:0.0:1786034340.541536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034340.541731:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636099072 00000100:00100000:3.0:1786034340.541738:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636099072 00000100:00100000:3.0:1786034340.541799:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786034340.541805:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afc5c485 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1872792636099072:12345-0@lo:38: 00000100:00100000:3.0:1786034340.541872:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afc5c485 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1872792636099072:12345-0@lo:38: Request processed in 66us (336us total) trans 0 rc -11/-11 00000100:00100000:3.0:1786034340.541878:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786034340.548087:0:5890:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004682bfbc pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5890:1872792636099200:0@lo:502: 00000100:00100000:2.0:1786034340.548165:0:5890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034340.548203:0:5890:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cd2e15c5 going to sleep for 11 seconds 00000100:00100000:1.0:1786034340.548255:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636099200 00000100:00100000:1.0:1786034340.548262:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636099200 00000100:00100000:1.0:1786034340.548311:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786034340.548319:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a456f52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5890:x1872792636099200:12345-0@lo:502: 00000100:00100000:1.0:1786034340.548556:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a456f52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5890:x1872792636099200:12345-0@lo:502: Request processed in 238us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034340.548564:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786034340.549916:0:5890:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004682bfbc pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5890:1872792636099200:0@lo:502: 00000040:00080000:2.0:1786034340.549954:0:5890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1786034340.550085:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1786034340.550109:0:5842:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786034340.550131:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: 00000000748c167a/0x490975051af3f965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f96c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034340.550142:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: 00000000748c167a/0x490975051af3f965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f96c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786034340.550190:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786034340.550192:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786034340.550193:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786034340.550194:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786034340.550195:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786034340.550197:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786034340.550198:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786034340.550199:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786034340.550201:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786034340.550202:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786034340.550203:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786034340.550204:0:5842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786034340.550207:0:5842:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1786034340.550210:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786034340.550211:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786034340.550212:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786034340.550213:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786034340.550214:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786034340.550215:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786034340.550216:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786034340.550217:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786034340.550218:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786034340.550219:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786034340.550220:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786034340.550221:0:5842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786034340.550236:0:5842:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1786034340.550246:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e13d695 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636099328:0@lo:253: 00000100:00100000:1.0:1786034340.550286:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034340.550312:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a57d0f0a going to sleep for 11 seconds 00000100:00100000:1.0:1786034340.550328:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636099328 00000100:00100000:1.0:1786034340.550332:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636099328 00000100:00100000:1.0:1786034340.550365:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786034340.550372:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005834fda9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5842:x1872792636099328:12345-0@lo:253: 20000000:01000000:1.0:1786034340.550424:0:5855:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1786034340.550532:0:5855:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1786034340.556583:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786034340.556597:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000d56ef3fe lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786034340.556603:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1786034340.556606:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a325552e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872792636099072:0@lo:38: 20000000:01000000:2.0:1786034340.652180:0:5855:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1786034340.652196:0:5855:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1786034340.652466:0:5877:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1786034340.652471:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1786034340.652491:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034340.652509:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000db35c072/0x490975051af3f950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f949 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034340.652517:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034340.652554:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000db35c072/0x490975051af3f950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3f949 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034340.652568:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000db35c072/0x490975051af3f950 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3f949 expref: 12 pid: 5856 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034340.652581:0:5877:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bdac7383 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1872792636099456:0@lo:104: 00000100:00100000:0.0:1786034340.652644:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034340.652703:0:5877:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e0175306 going to sleep for 11 seconds 00000100:00100000:3.0:1786034340.652818:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636099456 00000100:00100000:3.0:1786034340.652840:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636099456 00000100:00100000:3.0:1786034340.652879:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786034340.652886:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebf0aadb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5877:x1872792636099456:12345-0@lo:104: 00010000:00010000:3.0:1786034340.652896:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f950 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034340.652954:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786034340.652959:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebf0aadb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5877:x1872792636099456:12345-0@lo:104: Request processed in 74us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034340.652977:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1786034340.653073:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786034340.653079:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f950 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653086:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000767e893f already unused, calling callback (0000000012ddc10f) 10000000:00010000:2.0:1786034340.653088:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3f950 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653095:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3f950 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786034340.653102:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3f950 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786034340.653107:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1786034340.653136:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f950 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653142:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786034340.653153:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f950 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653168:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: 00000000767e893f/0x490975051af3f949 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f950 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653183:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034340.653185:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034340.653186:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034340.653267:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004682bfbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636099584:0@lo:103: 00000100:00100000:0.0:1786034340.653292:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034340.653354:0:5877:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bdac7383 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1872792636099456:0@lo:104: 00010000:00010000:0.0:1786034340.653368:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034340.653446:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636099584 00000100:00100000:2.0:1786034340.653450:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636099584 00010000:00010000:2.0:1786034340.653466:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000db35c072/0x490975051af3f950 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f949 expref: 13 pid: 5856 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034340.653493:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786034340.653499:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004522aca6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:3308:x1872792636099584:12345-0@lo:103: 00010000:00010000:2.0:1786034340.653508:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034340.653512:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000db35c072/0x490975051af3f950 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f949 expref: 13 pid: 5856 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653519:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000db35c072/0x490975051af3f950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3f949 expref: 13 pid: 5856 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653530:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000db35c072/0x490975051af3f950 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3f949 expref: 13 pid: 5856 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653540:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653546:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1786034340.653567:0:5846:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001096683s 00010000:00010000:2.0:1786034340.653570:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653576:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653581:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653587:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653592:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000058156d3e already unused, calling callback (00000000fb336b09) 00010000:00010000:2.0:1786034340.653594:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653601:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653617:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034340.653625:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034340.653652:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004522aca6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:3308:x1872792636099584:12345-0@lo:103: Request processed in 153us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034340.653657:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786034340.653705:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004682bfbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636099584:0@lo:103: 00010000:00010000:0.0:1786034340.653729:0:5877:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034340.653735:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034340.653740:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000058156d3e/0x490975051af3f981 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034340.669523:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005834fda9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:5842:x1872792636099328:12345-0@lo:253: Request processed in 119145us (119230us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034340.669538:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786034340.669731:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e13d695 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5842:1872792636099328:0@lo:253: 10000000:01000000:1.0:1786034340.669746:0:5842:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1786034340.669749:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786034340.669751:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786034340.669752:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786034340.669753:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786034340.669754:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786034340.669756:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786034340.669757:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786034340.669758:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786034340.669759:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786034340.669760:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786034340.669762:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786034340.669763:0:5842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786034340.669774:0:5842:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1786034340.678587:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1786034340.681159:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1786034340.681356:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1786034340.681891:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1786034340.682061:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1786034340.682225:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1786034340.684207:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1786034340.684390:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1786034340.686286:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1786034340.687779:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1786034340.688059:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1786034340.688257:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1786034340.853042:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1786034340.905275:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1786034340.905613:0:5895:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1786034340.905617:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1786034340.906849:0:5896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1786034340.909116:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1786034340.909249:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1786034340.909721:0:5842:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1786034340.909726:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1786034340.909845:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786034340.915325:0:5842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1786034340.916181:0:5842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1786034340.916211:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1786034340.916777:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1786034340.916983:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1786034340.918287:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1786034340.918978:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1786034340.919095:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1786034340.919226:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1786034340.919342:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1786034340.921647:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1786034340.921796:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1786034340.921959:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1786034340.922102:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1786034340.922234:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1786034340.923679:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1786034340.923881:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1786034340.924016:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1786034340.924142:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1786034340.924268:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1786034340.924421:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1786034340.926495:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1786034340.926651:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1786034340.926774:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1786034340.926921:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1786034340.927035:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1786034340.927169:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1786034340.927294:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1786034340.927436:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1786034340.927568:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1786034340.927700:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1786034340.927813:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1786034340.927974:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1786034340.928108:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1786034340.928233:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1786034340.928360:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1786034340.928501:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1786034340.928662:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1786034340.949275:0:5896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1786034340.986093:0:5842:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1786034340.986127:0:5842:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbe5441a7b988 00100000:10000000:2.0:1786034340.986135:0:5842:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1786034340.986882:0:5842:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1786034340.986896:0:5842:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.156@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1786034340.986908:0:5842:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1786034340.986932:0:5842:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1786034340.999810:0:5896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1786034341.001511:0:5896:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1786034341.001517:0:5896:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1786034341.494184:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034342.512706:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034343.541332:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034344.562223:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786034345.009913:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1786034345.009921:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff964559843800 from 3 10000000:01000000:3.0:1786034345.009926:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786034345.009969:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: 000000002b2ed548/0x490975051af3f988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034345.009981:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: 000000002b2ed548/0x490975051af3f988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034345.009991:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: 000000002b2ed548/0x490975051af3f988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034345.010013:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a4eb9c4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636099712:0@lo:101: 00000100:00100000:3.0:1786034345.010077:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034345.010126:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d86ac1de going to sleep for 11 seconds 00000100:00100000:0.0:1786034345.011366:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636099712 00000100:00100000:0.0:1786034345.011384:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636099712 00000100:00100000:0.0:1786034345.011459:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786034345.011469:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d16c1fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:5858:x1872792636099712:12345-0@lo:101: 00010000:00010000:0.0:1786034345.011490:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034345.011509:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ad591d34/0x490975051af3f98f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3f988 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034345.011531:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad591d34/0x490975051af3f98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3f988 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034345.011540:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ad591d34/0x490975051af3f98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f988 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034345.011549:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ad591d34, rc 0) 00000100:00100000:0.0:1786034345.011595:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d16c1fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5858:x1872792636099712:12345-0@lo:101: Request processed in 128us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034345.011602:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786034345.011707:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a4eb9c4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636099712:0@lo:101: 00010000:00010000:3.0:1786034345.011721:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: 000000002b2ed548/0x490975051af3f988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f98f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034345.011729:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: 000000002b2ed548/0x490975051af3f988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3f98f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034345.011775:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a4eb9c4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636099840:0@lo:256: 00000100:00100000:3.0:1786034345.011813:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034345.011875:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d86ac1de going to sleep for 11 seconds 00000100:00100000:3.0:1786034345.011890:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636099840 00000100:00100000:3.0:1786034345.011893:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636099840 00000100:00100000:3.0:1786034345.030993:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786034345.031014:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf0312d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5858:x1872792636099840:12345-0@lo:256: 20000000:01000000:3.0:1786034345.031048:0:5855:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1786034345.031066:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786034345.031069:0:5855:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1786034345.031188:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf0312d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5858:x1872792636099840:12345-0@lo:256: Request processed in 183us (19375us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034345.031196:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786034345.031358:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a4eb9c4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636099840:0@lo:256: 10000000:01000000:0.0:1786034345.031415:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786034345.031423:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: 000000002b2ed548/0x490975051af3f988 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f98f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034345.031432:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: 000000002b2ed548/0x490975051af3f988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f98f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034345.586010:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786034346.042204:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1786034346.042214:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786034346.042216:0:36:0:(import.c:65:import_set_state_nolock()) 00000000d56ef3fe lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786034346.042229:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d56ef3fe using connection 192.168.203.156@tcp/0@lo 00000100:00100000:2.0:1786034346.042262:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005e9ac32a x1872792636100096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786034346.042289:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e9ac32a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872792636100096:0@lo:38: 00000100:00100000:2.0:1786034346.042350:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034346.042561:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a683e45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636099968:0@lo:400: 00000100:00100000:0.0:1786034346.042595:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034346.042649:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636099968 00000100:00100000:0.0:1786034346.042656:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636099968 00000100:00100000:0.0:1786034346.042693:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786034346.042701:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f064d33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:3309:x1872792636099968:12345-0@lo:400: 00000100:00100000:0.0:1786034346.042755:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f064d33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:3309:x1872792636099968:12345-0@lo:400: Request processed in 54us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034346.042763:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786034346.042903:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a683e45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636099968:0@lo:400: 00000100:00100000:1.0:1786034346.043123:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636100096 00000100:00100000:1.0:1786034346.043127:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636100096 00000100:00100000:1.0:1786034346.043156:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786034346.043160:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078f26266 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1872792636100096:12345-0@lo:38: 00010000:00080000:1.0:1786034346.043181:0:5863:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:1.0:1786034346.043214:0:5863:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x490975051af3f996 00000004:00100000:1.0:1786034346.043270:0:5863:0:(mdt_handler.c:7332:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786034346.043389:0:5863:0:(import.c:65:import_set_state_nolock()) 00000000a5836789 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786034346.043431:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078f26266 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872792636100096:12345-0@lo:38: Request processed in 269us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034346.043437:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1786034346.043512:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005e9ac32a x1872792636100096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786034356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786034346.043526:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1786034346.043532:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1786034346.043536:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1786034346.043538:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000d56ef3fe lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1786034346.043543:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e9ac32a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872792636100096:0@lo:38: 00010000:00010000:3.0:1786034346.611793:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034347.634514:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034348.656816:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786034348.924217:0:6139:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1786034349.679927:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034350.707566:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034351.152031:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786034351.152065:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e9ac32a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636100224:0@lo:400: 00000100:00100000:2.0:1786034351.152159:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034351.152225:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006487f4f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636100352:0@lo:400: 00000100:00100000:2.0:1786034351.152256:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034351.152306:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636100224 00000100:00100000:2.0:1786034351.152316:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636100224 00000100:00100000:2.0:1786034351.152389:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786034351.152398:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1008945 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:3309:x1872792636100224:12345-0@lo:400: 00000100:00100000:2.0:1786034351.152455:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1008945 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:3309:x1872792636100224:12345-0@lo:400: Request processed in 58us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034351.152463:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786034351.152539:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e9ac32a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636100224:0@lo:400: 00000100:00100000:3.0:1786034351.153617:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636100352 00000100:00100000:3.0:1786034351.153624:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636100352 00000100:00100000:3.0:1786034351.153667:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786034351.153674:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d234b801 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636100352:12345-0@lo:400: 00000100:00100000:3.0:1786034351.153725:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d234b801 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636100352:12345-0@lo:400: Request processed in 52us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034351.153732:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1786034351.153941:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006487f4f6 x1872792636100352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034351.153954:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006487f4f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636100352:0@lo:400: 00010000:00010000:1.0:1786034351.727947:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034352.758251:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034353.776147:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034354.803168:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786034355.787190:0:6341:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe00cd7fb0 20000000:00000080:0.0:1786034355.787209:0:6341:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff964558d7c400 uarg=0000000000000000 20000000:01000000:0.0:1786034355.787251:0:6341:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1786034355.787257:0:6341:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1786034355.787262:0:6341:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1786034355.787701:0:6341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1786034355.787712:0:6341:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1786034355.794055:0:6341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786034355.794303:0:6341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1786034355.794360:0:6341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1786034355.794409:0:6341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1786034355.794425:0:6341:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1786034355.794440:0:6341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034355.794458:0:6341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000041bd66ad/0x490975051af3f95e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f957 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034355.794465:0:6341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034355.794502:0:6341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000041bd66ad/0x490975051af3f95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3f957 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034355.794516:0:6341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000041bd66ad/0x490975051af3f95e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3f957 expref: 11 pid: 5855 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034355.794541:0:6341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bdac7383 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6341:1872792636100480:0@lo:104: 00000100:00100000:0.0:1786034355.794599:0:6341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034355.794643:0:6341:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e698a2b2 going to sleep for 11 seconds 00000100:00100000:1.0:1786034355.794866:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636100480 00000100:00100000:1.0:1786034355.794873:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636100480 00000100:00100000:1.0:1786034355.794919:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786034355.794926:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fb532c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:6341:x1872792636100480:12345-0@lo:104: 00010000:00010000:1.0:1786034355.794937:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f95e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.794990:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786034355.794995:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fb532c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:6341:x1872792636100480:12345-0@lo:104: Request processed in 70us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034355.795002:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1786034355.795022:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034355.795026:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f95e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795034:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e1bdbb96 already unused, calling callback (0000000012ddc10f) 10000000:00010000:1.0:1786034355.795036:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3f95e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795043:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3f95e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786034355.795049:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3f95e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034355.795055:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786034355.795082:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f95e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795098:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786034355.795124:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f95e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795129:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: 00000000e1bdbb96/0x490975051af3f957 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f95e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795146:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034355.795147:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034355.795149:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034355.795166:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e13d695 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636100608:0@lo:103: 00000100:00100000:1.0:1786034355.795193:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034355.795256:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636100608 00000100:00100000:1.0:1786034355.795260:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636100608 00010000:00010000:1.0:1786034355.795274:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000041bd66ad/0x490975051af3f95e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f957 expref: 12 pid: 5855 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034355.795307:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786034355.795314:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000043bf88 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:3308:x1872792636100608:12345-0@lo:103: 00010000:00010000:1.0:1786034355.795323:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034355.795327:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000041bd66ad/0x490975051af3f95e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f957 expref: 12 pid: 5855 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795336:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000041bd66ad/0x490975051af3f95e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3f957 expref: 12 pid: 5855 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795349:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795356:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795377:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795383:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795388:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795393:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795398:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000058156d3e already unused, calling callback (00000000fb336b09) 00010000:00010000:1.0:1786034355.795401:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795407:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795414:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034355.795423:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034355.795448:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000043bf88 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:3308:x1872792636100608:12345-0@lo:103: Request processed in 136us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034355.795454:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786034355.795484:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e13d695 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636100608:0@lo:103: 00010000:00010000:0.0:1786034355.796819:0:6341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000041bd66ad/0x490975051af3f95e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3f957 expref: 11 pid: 5855 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034355.798589:0:6341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bdac7383 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6341:1872792636100480:0@lo:104: 00010000:00010000:0.0:1786034355.798622:0:6341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034355.798631:0:6341:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034355.798636:0:6341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034355.798641:0:6341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000058156d3e/0x490975051af3f99d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034355.825278:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034356.272031:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786034356.272055:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006487f4f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636100736:0@lo:400: 00000100:00100000:3.0:1786034356.272711:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034356.272855:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636100736 00000100:00100000:2.0:1786034356.272863:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636100736 00000100:00100000:2.0:1786034356.272910:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786034356.272918:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ab1d5f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636100736:12345-0@lo:400: 00000100:00100000:2.0:1786034356.272977:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ab1d5f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636100736:12345-0@lo:400: Request processed in 60us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034356.272984:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1786034356.273114:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006487f4f6 x1872792636100736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034356.273140:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006487f4f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636100736:0@lo:400: 00010000:00010000:1.0:1786034356.849604:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034357.872039:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034358.903229:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034359.929314:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034360.945364:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034361.394422:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e9ac32a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636100864:0@lo:400: 00000100:00100000:2.0:1786034361.394491:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034361.394545:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7172f87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636100992:0@lo:400: 00000100:00100000:2.0:1786034361.394568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034361.394596:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636100864 00000100:00100000:2.0:1786034361.394602:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636100864 00000100:00100000:2.0:1786034361.394637:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786034361.394643:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c5bb29a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:3310:x1872792636100864:12345-0@lo:400: 00000100:00100000:2.0:1786034361.394681:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c5bb29a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:3310:x1872792636100864:12345-0@lo:400: Request processed in 39us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034361.394687:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786034361.394713:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636100992 00000100:00100000:2.0:1786034361.394716:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636100992 00000100:00100000:2.0:1786034361.394734:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786034361.394738:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a63c9ad0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636100992:12345-0@lo:400: 00000100:00100000:2.0:1786034361.394773:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a63c9ad0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636100992:12345-0@lo:400: Request processed in 35us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034361.394779:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1786034361.394809:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b7172f87 x1872792636100992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034361.394820:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7172f87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636100992:0@lo:400: 00000100:00100000:2.0:1786034361.394857:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e9ac32a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636100864:0@lo:400: 00010000:00010000:3.0:1786034361.969029:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1786034362.928002:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786034362.928009:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff964559843800 from 1 10000000:01000000:1.0:1786034362.928014:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786034362.928051:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: 00000000a94089d3/0x490975051af3f9a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034362.928063:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: 00000000a94089d3/0x490975051af3f9a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034362.928073:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: 00000000a94089d3/0x490975051af3f9a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034362.928094:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e13d695 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636101120:0@lo:101: 00000100:00100000:1.0:1786034362.928156:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034362.928202:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set 0000000076dd4e02 going to sleep for 11 seconds 00000100:00100000:0.0:1786034362.928259:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636101120 00000100:00100000:0.0:1786034362.928267:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636101120 00000100:00100000:0.0:1786034362.928318:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786034362.928327:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042e83218 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:5858:x1872792636101120:12345-0@lo:101: 00010000:00010000:0.0:1786034362.928339:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034362.928350:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058156d3e/0x490975051af3f9ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3f9a4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034362.928371:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058156d3e/0x490975051af3f9ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3f9a4 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034362.928388:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058156d3e/0x490975051af3f9ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f9a4 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034362.928397:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058156d3e, rc 0) 00000100:00100000:0.0:1786034362.928717:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042e83218 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5858:x1872792636101120:12345-0@lo:101: Request processed in 391us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034362.928724:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786034362.928800:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e13d695 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636101120:0@lo:101: 00010000:00010000:1.0:1786034362.928812:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: 00000000a94089d3/0x490975051af3f9a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f9ab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034362.928847:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: 00000000a94089d3/0x490975051af3f9a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3f9ab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034362.928895:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e13d695 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636101248:0@lo:501: 00000100:00100000:1.0:1786034362.929015:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034362.929078:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636101248 00000100:00100000:2.0:1786034362.929083:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636101248 00000100:00100000:2.0:1786034362.929109:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786034362.929114:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edc39c70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5858:x1872792636101248:12345-0@lo:501: 00000100:00100000:2.0:1786034362.929371:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edc39c70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5858:x1872792636101248:12345-0@lo:501: Request processed in 256us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034362.929378:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786034362.929406:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set 0000000076dd4e02 going to sleep for 11 seconds 00000100:00100000:2.0:1786034362.929430:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e13d695 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636101248:0@lo:501: 00000100:00100000:2.0:1786034362.929464:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e9ac32a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636101376:0@lo:503: 00000100:00100000:2.0:1786034362.929496:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034362.929518:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set 000000002c231d0b going to sleep for 11 seconds 00000100:00100000:1.0:1786034362.929697:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636101376 00000100:00100000:1.0:1786034362.929707:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636101376 00000100:00100000:1.0:1786034362.929735:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786034362.929742:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a34e250 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5858:x1872792636101376:12345-0@lo:503: 00000100:00100000:1.0:1786034362.930019:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a34e250 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5858:x1872792636101376:12345-0@lo:503: Request processed in 278us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034362.930026:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786034362.930152:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e9ac32a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636101376:0@lo:503: 00000100:00100000:1.0:1786034362.936892:0:6656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084eaa8a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6656:1872792636101504:0@lo:502: 00000100:00100000:1.0:1786034362.936983:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034362.937016:0:6656:0:(client.c:2702:ptlrpc_set_wait()) set 000000003954d208 going to sleep for 11 seconds 00000100:00100000:0.0:1786034362.937120:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636101504 00000100:00100000:0.0:1786034362.937127:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636101504 00000100:00100000:0.0:1786034362.937174:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786034362.937182:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7fbfbee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6656:x1872792636101504:12345-0@lo:502: 00000100:00100000:0.0:1786034362.937435:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7fbfbee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6656:x1872792636101504:12345-0@lo:502: Request processed in 254us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034362.937443:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786034362.937722:0:6656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084eaa8a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6656:1872792636101504:0@lo:502: 00000020:01000000:1.0:1786034362.937751:0:6656:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786034362.937760:0:6656:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034362.937762:0:6656:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1786034362.937769:0:6656:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff964559843800 00000020:00000080:1.0:1786034362.937771:0:6656:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1786034362.937898:0:6656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6656:1872792636101632:0@lo:502: 00000100:00100000:1.0:1786034362.937941:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034362.937962:0:6656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645595b6840 going to sleep for 11 seconds 00000100:00100000:2.0:1786034362.938847:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636101632 00000100:00100000:2.0:1786034362.938853:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636101632 00000100:00100000:2.0:1786034362.938884:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786034362.938891:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6656:x1872792636101632:12345-0@lo:502: 00000100:00100000:2.0:1786034362.939042:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6656:x1872792636101632:12345-0@lo:502: Request processed in 150us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034362.939050:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786034362.939086:0:6656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6656:1872792636101632:0@lo:502: 00000020:01000000:2.0:1786034362.939106:0:6656:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786034362.939111:0:6656:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034362.939113:0:6656:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1786034362.939116:0:6656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1786034362.939163:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1786034362.939180:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786034362.939189:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541653800/0x490975051af3f9a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f9ab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034362.939199:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964541653800/0x490975051af3f9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f9ab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034362.992009:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034364.016111:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034365.040262:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1786034365.584816:0:6717:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1786034365.584820:0:6717:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1786034365.584953:0:6717:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff964548917000 00000020:01000004:3.0:1786034365.584969:0:6717:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1786034365.584979:0:6717:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1786034365.584990:0:6717:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9645519199c0) 00000020:00000080:3.0:1786034365.585005:0:6717:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1786034365.634318:0:6717:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1786034365.634706:0:6717:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1786034365.688730:0:6717:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1786034365.696879:0:6717:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786034365.696909:0:6717:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1786034365.696961:0:6717:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1786034365.696983:0:6717:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1786034365.697804:0:6717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1786034365.697814:0:6717:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786034365.698211:0:6717:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x490975051af3f9b9 00000020:01000004:3.0:1786034365.698221:0:6717:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1786034365.698242:0:6717:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1786034365.698245:0:6717:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1786034365.698251:0:6717:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1786034365.698255:0:6717:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1786034365.698275:0:6717:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9645519a0000) 00000020:00000080:3.0:1786034365.698287:0:6717:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1786034365.701045:0:6717:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786034365.703348:0:6717:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1786034365.703357:0:6717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1786034365.705025:0:6717:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1786034365.705034:0:6717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1786034365.705674:0:6717:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1786034365.705685:0:6717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1786034365.708987:0:6717:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786034365.710670:0:6717:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1786034365.710679:0:6717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1786034365.711526:0:6717:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1786034365.711533:0:6717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1786034365.749798:0:6717:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786034365.750381:0:6717:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1786034365.750398:0:6717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1786034365.752545:0:6717:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1786034365.752562:0:6717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1786034365.753899:0:6717:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1786034365.753907:0:6717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1786034365.757243:0:6717:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786034365.757419:0:6717:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1786034365.757680:0:6717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1786034365.760103:0:6717:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1786034365.760112:0:6717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1786034365.850897:0:6717:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786034365.851064:0:6717:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1786034365.851071:0:6717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1786034365.854633:0:6717:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1786034365.854645:0:6717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1786034365.855073:0:6717:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1786034365.855093:0:6717:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1786034365.855099:0:6717:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1786034365.932160:0:6717:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786034365.932193:0:6717:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.156@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1786034365.932196:0:6717:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786034365.932198:0:6717:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786034365.932199:0:6717:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034365.932201:0:6717:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786034365.932214:0:6717:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034365.932216:0:6717:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034365.932217:0:6717:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786034365.932218:0:6717:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786034365.932219:0:6717:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786034365.932221:0:6717:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034365.932222:0:6717:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786034365.932230:0:6717:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1786034365.932232:0:6717:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786034365.932233:0:6717:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786034365.932234:0:6717:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034365.932234:0:6717:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786034365.932235:0:6717:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034365.932236:0:6717:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034365.932237:0:6717:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786034365.932238:0:6717:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786034365.932239:0:6717:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786034365.932240:0:6717:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034365.932241:0:6717:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786034365.932264:0:6717:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1786034365.932281:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636101760:0@lo:253: 00000100:00100000:2.0:1786034365.932350:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034365.932387:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c7516c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034365.932460:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636101760 00000100:00100000:0.0:1786034365.932467:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636101760 00000100:00100000:0.0:1786034365.932514:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1786034365.932522:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6717:x1872792636101760:12345-0@lo:253: 20000000:01000000:0.0:1786034365.932559:0:5856:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1786034365.932569:0:5856:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1786034365.932573:0:5856:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1786034365.932576:0:5856:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1786034365.933361:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786034365.933557:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1786034365.933569:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1786034365.933601:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1786034365.933608:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1786034365.933630:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1786034365.933681:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1786034365.933995:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1786034365.934011:0:5856:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.156@tcp 20000000:01000000:0.0:1786034365.934013:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.156@tcp (null) (null) (null) 00000040:00080000:0.0:1786034365.934047:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1786034365.934054:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1786034365.934095:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1786034365.934103:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.156@tcp (null) (null) 00000040:00080000:0.0:1786034365.934134:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1786034365.934143:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1786034365.934172:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1786034365.934241:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1786034365.940421:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1786034365.940452:0:5856:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.156@tcp 20000000:01000000:0.0:1786034365.940455:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.156@tcp (null) (null) (null) 00000040:00080000:0.0:1786034365.940516:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1786034365.940525:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1786034365.943416:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1786034365.943434:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.156@tcp (null) (null) 00000040:00080000:0.0:1786034365.943516:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1786034365.943527:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1786034365.943558:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1786034365.943587:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1786034365.943621:0:5856:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1786034365.943623:0:5856:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1786034365.943629:0:5856:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1786034365.943630:0:5856:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1786034365.943633:0:5856:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1786034365.943644:0:5856:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1786034365.943646:0:5856:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1786034365.943686:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1786034365.943688:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1786034365.947182:0:6732:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1786034365.947267:0:6732:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1786034365.947315:0:6732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1786034365.947872:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1786034365.947915:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1786034365.947951:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1786034365.947965:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1786034365.947968:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1786034365.955533:0:6733:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1786034365.955716:0:6733:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1786034365.955769:0:6733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1786034365.957887:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1786034365.957931:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1786034365.957994:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1786034365.958009:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1786034365.958012:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1786034365.959301:0:6734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1786034365.959621:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1786034365.960373:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1786034365.960457:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:3.0:1786034365.960482:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1786034365.960500:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034365.960517:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9645413f0400/0x490975051af3f8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f8d9 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034365.960525:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964562313800/0x490975051af3f8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f8f5 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034365.960561:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964541652600/0x490975051af3f96c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f965 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034365.960568:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034365.960610:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964541652600/0x490975051af3f96c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3f965 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034365.960623:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964541652600/0x490975051af3f96c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3f965 expref: 12 pid: 5855 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034365.960637:0:5856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e60000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5856:1872792636101888:0@lo:104: 00000100:00100000:3.0:1786034365.960692:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034365.960736:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636101888 00000100:00100000:2.0:1786034365.960743:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636101888 00010000:00010000:3.0:1786034365.960758:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964562313800/0x490975051af3f8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3f8f5 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034365.960765:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964562313800/0x490975051af3f8fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3f8f5 expref: 12 pid: 5853 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034365.960774:0:5856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e63800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5856:1872792636102016:0@lo:104: 00000100:00100000:2.0:1786034365.960782:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786034365.960790:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5856:x1872792636101888:12345-0@lo:104: 00000100:00100000:3.0:1786034365.960794:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786034365.960802:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af3f965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f96c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034365.960808:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9645413f0400/0x490975051af3f8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3f8d9 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034365.960815:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9645413f0400/0x490975051af3f8e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3f8d9 expref: 12 pid: 5855 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034365.960848:0:5856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5856:1872792636102144:0@lo:104: 00010000:00010000:2.0:1786034365.960860:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786034365.960866:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5856:x1872792636101888:12345-0@lo:104: Request processed in 78us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034365.960873:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786034365.960874:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034365.960888:0:5856:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034365.960891:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636102016 00000100:00100000:3.0:1786034365.960908:0:5856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e60000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5856:1872792636101888:0@lo:104: 00010000:00010000:0.0:1786034365.961000:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034365.961006:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af3f965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f96c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961014:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0000 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034365.961018:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af3f965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3f96c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961026:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af3f965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3f96c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034365.961033:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af3f965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3f96c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034365.961039:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786034365.961068:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af3f965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f96c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961082:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034365.961110:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af3f965 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f96c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961116:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af3f965 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f96c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961139:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034365.961140:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034365.961142:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034365.961152:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636102272:0@lo:103: 00000100:00100000:0.0:1786034365.961178:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034365.961269:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636102016 00000100:00100000:2.0:1786034365.961287:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636102144 00000100:00100000:2.0:1786034365.961290:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636102144 00000100:00100000:2.0:1786034365.961314:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786034365.961320:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+4:5856:x1872792636102016:12345-0@lo:104: 00010000:00010000:2.0:1786034365.961328:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3f8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f8fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034365.961367:0:5856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e63800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5856:1872792636102016:0@lo:104: 00010000:00010000:2.0:1786034365.961372:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786034365.961377:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+4:5856:x1872792636102016:12345-0@lo:104: Request processed in 57us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034365.961382:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786034365.961395:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1786034365.961399:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1786034365.961401:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5856:x1872792636102144:12345-0@lo:104: 00010000:00010000:0.0:1786034365.961404:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3f8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f8fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034365.961408:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af3f8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f8e0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961411:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964540031400 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034365.961414:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3f8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3f8fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961421:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3f8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3f8fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034365.961428:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3f8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3f8fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034365.961434:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786034365.961458:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3f8f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f8fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961473:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034365.961489:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3f8f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f8fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961495:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3f8f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f8fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961505:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034365.961507:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034365.961509:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034365.961519:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636102400:0@lo:103: 00000100:00100000:0.0:1786034365.961554:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034365.961569:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636102272 00000100:00100000:1.0:1786034365.961573:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636102272 00010000:00010000:1.0:1786034365.961591:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964541652600/0x490975051af3f96c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f965 expref: 13 pid: 5855 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034365.961609:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636102400 00000100:00100000:1.0:1786034365.961617:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636102400 00010000:00010000:1.0:1786034365.961631:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964562313800/0x490975051af3f8fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f8f5 expref: 14 pid: 5853 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034365.961645:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786034365.961650:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:3308:x1872792636102272:12345-0@lo:103: 00010000:00010000:1.0:1786034365.961659:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034365.961752:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786034365.961758:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5856:x1872792636102144:12345-0@lo:104: Request processed in 357us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034365.961765:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786034365.961852:0:5856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5856:1872792636102144:0@lo:104: 00010000:00010000:3.0:1786034365.961870:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961918:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034365.961923:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af3f8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f8e0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961929:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0200 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034365.961933:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af3f8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3f8e0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961940:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af3f8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3f8e0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034365.961946:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af3f8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3f8e0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034365.961951:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786034365.961972:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964541652600/0x490975051af3f96c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f965 expref: 14 pid: 5855 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961975:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af3f8d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f8e0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.961983:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964541652600/0x490975051af3f96c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3f965 expref: 14 pid: 5855 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.961990:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786034365.961996:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964541652600/0x490975051af3f96c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3f965 expref: 14 pid: 5855 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.962005:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af3f8d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f8e0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.962008:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786034365.962011:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af3f8d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f8e0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034365.962023:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034365.962024:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034365.962026:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034365.962033:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786034365.962037:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:3308:x1872792636102272:12345-0@lo:103: Request processed in 388us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034365.962041:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636102528:0@lo:103: 00000100:00100000:1.0:1786034365.962043:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786034365.962058:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786034365.962062:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034365.962064:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:3309:x1872792636102400:12345-0@lo:103: 00010000:00010000:1.0:1786034365.962071:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034365.962076:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964562313800/0x490975051af3f8fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f8f5 expref: 12 pid: 5853 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.962084:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964562313800/0x490975051af3f8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3f8f5 expref: 12 pid: 5853 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.962094:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964562313800/0x490975051af3f8fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3f8f5 expref: 12 pid: 5853 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.962110:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034365.962142:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:3309:x1872792636102400:12345-0@lo:103: Request processed in 79us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034365.962149:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786034365.962159:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636102528 00000100:00100000:1.0:1786034365.962163:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636102528 00010000:00010000:1.0:1786034365.962173:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9645413f0400/0x490975051af3f8e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f8d9 expref: 11 pid: 5855 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034365.962185:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786034365.962191:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:3309:x1872792636102528:12345-0@lo:103: 00010000:00010000:1.0:1786034365.962197:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1786034365.962233:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636102400:0@lo:103: 00010000:00010000:1.0:1786034365.963026:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9645413f0400/0x490975051af3f8e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f8d9 expref: 11 pid: 5855 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.963039:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9645413f0400/0x490975051af3f8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3f8d9 expref: 11 pid: 5855 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.963049:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f0400/0x490975051af3f8e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3f8d9 expref: 11 pid: 5855 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.963060:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.963067:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.963078:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.963094:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.963101:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.963107:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.963113:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312c00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034365.963117:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.963124:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.963137:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034365.963146:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034365.963174:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+10:3309:x1872792636102528:12345-0@lo:103: Request processed in 983us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034365.963180:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786034365.963713:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636102272:0@lo:103: 00000100:00100000:0.0:1786034365.965332:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636102528:0@lo:103: 00010000:00010000:3.0:1786034365.965649:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034365.965660:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034365.965666:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964562312c00/0x490975051af3f9c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1786034365.965680:0:5856:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1786034366.066226:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034366.078989:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+9:6717:x1872792636101760:12345-0@lo:253: Request processed in 146459us (146631us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.079002:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786034366.079097:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636101760:0@lo:253: 10000000:01000000:2.0:1786034366.079111:0:6717:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1786034366.079114:0:6717:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786034366.079116:0:6717:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786034366.079117:0:6717:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034366.079119:0:6717:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1786034366.079120:0:6717:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034366.079134:0:6717:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034366.079135:0:6717:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786034366.079137:0:6717:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1786034366.079138:0:6717:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034366.079139:0:6717:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1786034366.079157:0:6717:0:(tgt_mount.c:101:server_register_mount()) register mount ffff964548917000 from lustre-OST0000 10000000:01000000:2.0:1786034366.079177:0:6717:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1786034366.079180:0:6717:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1786034366.079186:0:6717:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff964542f499c0 local copy 10000000:01000000:2.0:1786034366.079190:0:6717:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786034366.079233:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034366.079244:0:6717:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034366.079253:0:6717:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034366.079270:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636102656:0@lo:101: 00000100:00100000:2.0:1786034366.079303:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034366.079356:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c751c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786034366.079403:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636102656 00000100:00100000:1.0:1786034366.079409:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636102656 00000100:00100000:1.0:1786034366.079464:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786034366.079472:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+9:6717:x1872792636102656:12345-0@lo:101: 00010000:00010000:1.0:1786034366.079483:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034366.079495:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964541652600/0x490975051af3f9d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3f9ce expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034366.079518:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964541652600/0x490975051af3f9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3f9ce expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034366.079528:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964541652600/0x490975051af3f9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f9ce expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034366.079538:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964541652600, rc 0) 00000100:00100000:1.0:1786034366.079569:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+10:6717:x1872792636102656:12345-0@lo:101: Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.079575:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1786034366.079778:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636102656:0@lo:101: 00010000:00010000:3.0:1786034366.079790:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x490975051af3f9d5 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.079798:0:6717:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x490975051af3f9d5 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034366.079896:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636102784:0@lo:501: 00000100:00100000:3.0:1786034366.079920:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034366.079935:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034366.079982:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636102784 00000100:00100000:1.0:1786034366.079987:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636102784 00000100:00100000:1.0:1786034366.080014:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786034366.080020:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+10:6717:x1872792636102784:12345-0@lo:501: 00000100:00100000:1.0:1786034366.080176:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+10:6717:x1872792636102784:12345-0@lo:501: Request processed in 155us (254us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786034366.080183:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1786034366.080338:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636102784:0@lo:501: 10000000:01000000:3.0:1786034366.080355:0:6717:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1786034366.080376:0:6717:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1786034366.080381:0:6717:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x490975051af3f9d5 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.080388:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x490975051af3f9d5 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.080395:0:6717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x490975051af3f9d5 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.080415:0:6717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1786034366.080433:0:6717:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff964548917000 10000000:01000000:3.0:1786034366.080437:0:6717:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1786034366.080441:0:6717:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff964542f499c0 10000000:01000000:3.0:1786034366.080442:0:6717:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1786034366.080445:0:6717:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff964542f499c0 from 1 10000000:01000000:3.0:1786034366.080447:0:6717:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1786034366.080460:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562312c00/0x490975051af3f9dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.080466:0:6717:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964562312c00/0x490975051af3f9dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.080473:0:6717:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964562312c00/0x490975051af3f9dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034366.080481:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636102912:0@lo:101: 00000100:00100000:3.0:1786034366.080504:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034366.080521:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c3840 going to sleep for 11 seconds 00000100:00100000:2.0:1786034366.080687:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636102912 00000100:00100000:2.0:1786034366.080691:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636102912 00000100:00100000:2.0:1786034366.080721:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786034366.080727:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+10:6717:x1872792636102912:12345-0@lo:101: 00010000:00010000:2.0:1786034366.080733:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034366.080741:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9645413f1000/0x490975051af3f9e3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3f9dc expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034366.080755:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f1000/0x490975051af3f9e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3f9dc expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034366.080774:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9645413f1000/0x490975051af3f9e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f9dc expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034366.080781:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f1000, rc 0) 00000100:00100000:2.0:1786034366.080809:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:6717:x1872792636102912:12345-0@lo:101: Request processed in 83us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034366.080814:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1786034366.080883:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034366.080889:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x490975051af3f9d5 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034366.080895:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1e00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:1.0:1786034366.080899:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x490975051af3f9d5 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034366.080911:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x490975051af3f9d5 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786034366.080917:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x490975051af3f9d5 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034366.080922:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786034366.080937:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x490975051af3f9d5 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034366.080942:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786034366.080979:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x490975051af3f9d5 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034366.080985:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3f9ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x490975051af3f9d5 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034366.080999:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034366.081001:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034366.081002:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034366.081008:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786034366.081017:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636103040:0@lo:103: 00000100:00100000:1.0:1786034366.081041:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034366.081066:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636103040 00000100:00100000:1.0:1786034366.081069:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636103040 00000100:00100000:1.0:1786034366.081092:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786034366.081097:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:3308:x1872792636103040:12345-0@lo:103: 00010000:00010000:1.0:1786034366.081104:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034366.081114:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964541652600/0x490975051af3f9d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3f9ce expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034366.081151:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034366.081174:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+10:3308:x1872792636103040:12345-0@lo:103: Request processed in 77us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.081180:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786034366.081215:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636103040:0@lo:103: 00000100:00100000:3.0:1786034366.081318:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636102912:0@lo:101: 00010000:00010000:3.0:1786034366.081329:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964562312c00/0x490975051af3f9dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f9e3 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.081337:0:6717:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964562312c00/0x490975051af3f9dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3f9e3 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034366.081351:0:6717:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1786034366.081367:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562312c00/0x490975051af3f9dc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f9e3 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.081374:0:6717:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964562312c00/0x490975051af3f9dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f9e3 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034366.081380:0:6717:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1786034366.081384:0:6717:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786034366.081388:0:6717:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1786034366.081390:0:6717:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1786034366.081402:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.081409:0:6717:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.081416:0:6717:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034366.081530:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636103168:0@lo:101: 00000100:00100000:3.0:1786034366.081659:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034366.081684:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c3840 going to sleep for 11 seconds 00000100:00100000:2.0:1786034366.081736:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636103168 00000100:00100000:2.0:1786034366.081741:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636103168 00000100:00100000:2.0:1786034366.081770:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786034366.081776:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+10:6717:x1872792636103168:12345-0@lo:101: 00010000:00010000:2.0:1786034366.081782:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034366.081790:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9645413f1c00/0x490975051af3f9f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3f9ea expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034366.081802:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f1c00/0x490975051af3f9f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3f9ea expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034366.081809:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9645413f1c00/0x490975051af3f9f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f9ea expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034366.081814:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f1c00, rc 0) 00000100:00100000:2.0:1786034366.081870:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:6717:x1872792636103168:12345-0@lo:101: Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034366.081876:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1786034366.082029:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636103168:0@lo:101: 00010000:00010000:3.0:1786034366.082040:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f9f1 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.082048:0:6717:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3f9f1 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034366.082098:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636103296:0@lo:501: 00000100:00100000:3.0:1786034366.082117:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034366.082141:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c3840 going to sleep for 11 seconds 00000100:00100000:1.0:1786034366.082181:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636103296 00000100:00100000:1.0:1786034366.082184:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636103296 00000100:00100000:1.0:1786034366.082217:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786034366.082223:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:6717:x1872792636103296:12345-0@lo:501: 00000100:00100000:1.0:1786034366.082400:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:6717:x1872792636103296:12345-0@lo:501: Request processed in 177us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.082407:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1786034366.082559:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636103296:0@lo:501: 00000100:00100000:3.0:1786034366.082582:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636103424:0@lo:503: 00000100:00100000:3.0:1786034366.082703:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034366.082723:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c3840 going to sleep for 11 seconds 00000100:00100000:1.0:1786034366.082766:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636103424 00000100:00100000:1.0:1786034366.082769:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636103424 00000100:00100000:1.0:1786034366.082794:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786034366.082799:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:6717:x1872792636103424:12345-0@lo:503: 00000100:00100000:1.0:1786034366.082942:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:6717:x1872792636103424:12345-0@lo:503: Request processed in 142us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.082948:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1786034366.083034:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636103424:0@lo:503: 00000040:00080000:3.0:1786034366.083250:0:6717:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786034366.083305:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636103552:0@lo:502: 00000100:00100000:3.0:1786034366.083335:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034366.083360:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c3840 going to sleep for 11 seconds 00000100:00100000:1.0:1786034366.083406:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636103552 00000100:00100000:1.0:1786034366.083410:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636103552 00000100:00100000:1.0:1786034366.083530:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786034366.083537:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:6717:x1872792636103552:12345-0@lo:502: 00000100:00100000:1.0:1786034366.083730:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:6717:x1872792636103552:12345-0@lo:502: Request processed in 192us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.083745:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1786034366.083807:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636103552:0@lo:502: 00000040:00080000:3.0:1786034366.084036:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1786034366.084081:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1786034366.084113:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1786034366.084156:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1786034366.084192:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1786034366.084241:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1786034366.084269:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636103680:0@lo:502: 00000100:00100000:3.0:1786034366.084301:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034366.084711:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c3840 going to sleep for 11 seconds 00000100:00100000:2.0:1786034366.084796:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636103680 00000100:00100000:2.0:1786034366.084800:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636103680 00000100:00100000:0.0:1786034366.084985:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1786034366.084992:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:6717:x1872792636103680:12345-0@lo:502: 00000100:00100000:0.0:1786034366.085148:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:6717:x1872792636103680:12345-0@lo:502: Request processed in 155us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034366.085155:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1786034366.085227:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636103680:0@lo:502: 00000040:00080000:3.0:1786034366.085298:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1786034366.085307:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1786034366.086541:0:6736:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1786034366.086564:0:6736:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1786034366.086571:0:6736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034366.086573:0:6736:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1786034366.086579:0:6736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786034366.086688:0:6736:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9645595e19c0) 00000020:00000080:2.0:1786034366.086714:0:6736:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1786034366.086721:0:6736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1786034366.086793:0:6736:0:(tgt_mount.c:153:server_get_mount()) get mount ffff964548917000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1786034366.086799:0:6736:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1786034366.086805:0:6736:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x490975051af3f9ff 00010000:00010000:3.0:1786034366.090953:0:6736:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1786034366.091289:0:6736:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1786034366.093686:0:6736:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1786034366.094242:0:6736:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1786034366.105518:0:6736:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1786034366.106285:0:6736:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1786034366.107730:0:6736:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1786034366.107740:0:6736:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786034366.107746:0:6736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034366.107749:0:6736:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1786034366.107751:0:6736:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786034366.107754:0:6736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034366.107756:0:6736:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786034366.107759:0:6736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786034366.107761:0:6736:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1786034366.107798:0:6736:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786034366.107801:0:6736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034366.107802:0:6736:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1786034366.107805:0:6736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1786034366.110148:0:6717:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1786034366.110178:0:6717:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1786034366.110210:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f9f1 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.110223:0:6717:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f9f1 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034366.110231:0:6717:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff964548917000 from 1 10000000:01000000:3.0:1786034366.110234:0:6717:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786034366.110268:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.110276:0:6717:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.110287:0:6717:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034366.110307:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636103808:0@lo:101: 00000100:00100000:3.0:1786034366.110371:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034366.110429:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034366.110568:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636103808 00000100:00100000:1.0:1786034366.110576:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636103808 00000100:00100000:1.0:1786034366.110717:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1786034366.110726:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:6717:x1872792636103808:12345-0@lo:101: 00010000:00010000:1.0:1786034366.110739:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034366.110750:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964541652600/0x490975051af3fa0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fa06 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034366.110773:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964541652600/0x490975051af3fa0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fa06 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034366.110783:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964541652600/0x490975051af3fa0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fa06 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034366.110792:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964541652600, rc 0) 00000100:00100000:1.0:1786034366.110858:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6717:x1872792636103808:12345-0@lo:101: Request processed in 132us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.110865:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786034366.110941:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636103808:0@lo:101: 00010000:00010000:2.0:1786034366.110955:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa0d expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034366.110965:0:6717:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fa0d expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034366.111044:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636103936:0@lo:501: 00000100:00100000:2.0:1786034366.111069:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034366.111102:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c751b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786034366.111142:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636103936 00000100:00100000:1.0:1786034366.111146:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636103936 00000100:00100000:1.0:1786034366.111174:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1786034366.111180:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6717:x1872792636103936:12345-0@lo:501: 00000100:00100000:1.0:1786034366.111375:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6717:x1872792636103936:12345-0@lo:501: Request processed in 194us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.111386:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1786034366.111456:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636103936:0@lo:501: 00000100:00100000:2.0:1786034366.111480:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104064:0@lo:503: 00000100:00100000:2.0:1786034366.111513:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034366.111532:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c751b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786034366.111700:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636104064 00000100:00100000:1.0:1786034366.111704:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636104064 00000100:00100000:1.0:1786034366.111731:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786034366.111737:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6717:x1872792636104064:12345-0@lo:503: 00000100:00100000:1.0:1786034366.111951:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6717:x1872792636104064:12345-0@lo:503: Request processed in 214us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.111958:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1786034366.112033:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104064:0@lo:503: 00000040:00080000:2.0:1786034366.112256:0:6717:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786034366.112308:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104192:0@lo:502: 00000100:00100000:2.0:1786034366.112343:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034366.112442:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c751b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786034366.125706:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636104192 00000100:00100000:1.0:1786034366.125720:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636104192 00000100:00100000:1.0:1786034366.125783:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786034366.125793:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6717:x1872792636104192:12345-0@lo:502: 00000100:00100000:1.0:1786034366.127557:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6717:x1872792636104192:12345-0@lo:502: Request processed in 1762us (15210us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.127566:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1786034366.131160:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104192:0@lo:502: 00000040:00080000:2.0:1786034366.131496:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1786034366.131567:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1786034366.131773:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104320:0@lo:502: 00000100:00100000:2.0:1786034366.131860:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034366.131891:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c751b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786034366.132029:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636104320 00000100:00100000:1.0:1786034366.132035:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636104320 00000100:00100000:1.0:1786034366.132075:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786034366.132084:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6717:x1872792636104320:12345-0@lo:502: 00000100:00100000:1.0:1786034366.132265:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6717:x1872792636104320:12345-0@lo:502: Request processed in 180us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.132272:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786034366.132411:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104320:0@lo:502: 00000040:00080000:2.0:1786034366.132512:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1786034366.132522:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1786034366.133214:0:6740:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786034366.133223:0:6740:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034366.133225:0:6740:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1786034366.133231:0:6740:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff964548917000 00000020:00000080:2.0:1786034366.133233:0:6740:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786034366.133253:0:6740:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786034366.133256:0:6740:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034366.133258:0:6740:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1786034366.133267:0:6740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1786034366.133379:0:6717:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1786034366.133396:0:6717:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786034366.133414:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa0d expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.133442:0:6717:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa0d expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034366.133476:0:6717:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1786034366.133479:0:6717:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff964548917000 10000000:01000000:0.0:1786034366.133482:0:6717:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff964548917000 10000000:01000000:0.0:1786034366.133485:0:6717:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786034366.133490:0:6717:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff964548917000 from 1 10000000:01000000:0.0:1786034366.133492:0:6717:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786034366.133516:0:6717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.133523:0:6717:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.133532:0:6717:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034366.133555:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104448:0@lo:101: 00000100:00100000:0.0:1786034366.133596:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034366.133621:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff96458093a780 going to sleep for 11 seconds 00000100:00100000:3.0:1786034366.133716:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636104448 00000100:00100000:3.0:1786034366.133722:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636104448 00000100:00100000:3.0:1786034366.133754:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1786034366.133762:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6717:x1872792636104448:12345-0@lo:101: 00010000:00010000:3.0:1786034366.133772:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034366.133782:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964562313c00/0x490975051af3fa1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fa14 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.133802:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964562313c00/0x490975051af3fa1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fa14 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.133810:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964562313c00/0x490975051af3fa1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fa14 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.133818:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562313c00, rc 0) 00000100:00100000:3.0:1786034366.133874:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:6717:x1872792636104448:12345-0@lo:101: Request processed in 113us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034366.133880:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786034366.134069:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104448:0@lo:101: 00010000:00010000:0.0:1786034366.134081:0:6717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa1b expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.134089:0:6717:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fa1b expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034366.134158:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104576:0@lo:501: 00000100:00100000:0.0:1786034366.134179:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034366.134214:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff96458093a780 going to sleep for 11 seconds 00000100:00100000:1.0:1786034366.134258:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636104576 00000100:00100000:1.0:1786034366.134262:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636104576 00000100:00100000:1.0:1786034366.134291:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1786034366.134298:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:6717:x1872792636104576:12345-0@lo:501: 00000100:00100000:1.0:1786034366.134482:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:6717:x1872792636104576:12345-0@lo:501: Request processed in 184us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.134488:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786034366.134696:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104576:0@lo:501: 00000100:00100000:0.0:1786034366.134720:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104704:0@lo:503: 00000100:00100000:0.0:1786034366.134752:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034366.134772:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff96458093a780 going to sleep for 11 seconds 00000100:00100000:1.0:1786034366.134914:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636104704 00000100:00100000:1.0:1786034366.134919:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636104704 00000100:00100000:1.0:1786034366.134944:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786034366.134949:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:6717:x1872792636104704:12345-0@lo:503: 00000100:00100000:1.0:1786034366.135106:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:6717:x1872792636104704:12345-0@lo:503: Request processed in 157us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.135113:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1786034366.143799:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104704:0@lo:503: 00000040:00080000:2.0:1786034366.144194:0:6717:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786034366.144276:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104832:0@lo:502: 00000100:00100000:2.0:1786034366.144348:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034366.144386:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c751540 going to sleep for 11 seconds 00000100:00100000:3.0:1786034366.144790:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636104832 00000100:00100000:3.0:1786034366.144796:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636104832 00000100:00100000:3.0:1786034366.144866:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786034366.144875:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:6717:x1872792636104832:12345-0@lo:502: 00000100:00100000:3.0:1786034366.145067:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:6717:x1872792636104832:12345-0@lo:502: Request processed in 192us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034366.145075:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786034366.145525:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104832:0@lo:502: 00000040:00080000:2.0:1786034366.145818:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1786034366.145883:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1786034366.145916:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1786034366.145961:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1786034366.145998:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1786034366.146059:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1786034366.146101:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1786034366.146136:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1786034366.146183:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1786034366.146234:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1786034366.146273:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1786034366.146349:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1786034366.146387:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1786034366.146417:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1786034366.146478:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1786034366.146516:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1786034366.146557:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1786034366.146601:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1786034366.146637:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1786034366.146671:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1786034366.146713:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1786034366.146743:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1786034366.146770:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1786034366.146807:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1786034366.146855:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1786034366.146896:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1786034366.146935:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1786034366.146978:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1786034366.147005:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104960:0@lo:502: 00000100:00100000:2.0:1786034366.147046:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034366.147069:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c751540 going to sleep for 11 seconds 00000100:00100000:1.0:1786034366.147437:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636104960 00000100:00100000:1.0:1786034366.147443:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636104960 00000100:00100000:1.0:1786034366.147481:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786034366.147488:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:6717:x1872792636104960:12345-0@lo:502: 00000100:00100000:1.0:1786034366.147656:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:6717:x1872792636104960:12345-0@lo:502: Request processed in 167us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.147663:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1786034366.148514:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636104960:0@lo:502: 00000040:00080000:2.0:1786034366.148754:0:6717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1786034366.148766:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1786034366.158169:0:6741:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1786034366.158184:0:6741:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9645519a4d40) 00000020:00000080:3.0:1786034366.158224:0:6741:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1786034366.158705:0:6741:0:(tgt_mount.c:153:server_get_mount()) get mount ffff964548917000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1786034366.158710:0:6741:0:(tgt_mount.c:187:server_put_mount()) put mount ffff964548917000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1786034366.158713:0:6741:0:(obd_mount.c:710:lustre_put_lsi()) put ffff964548917000 3 00010000:00080000:3.0:1786034366.158740:0:6741:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96444501e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.156@tcp at head 00010000:00010000:3.0:1786034366.162024:0:6741:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1786034366.162115:0:6741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1786034366.162147:0:6741:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786034366.162157:0:6741:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x490975051af3fa29 00000100:00080000:3.0:1786034366.162166:0:6741:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786034366.162172:0:6741:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96444501e000 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:3.0:1786034366.162215:0:6741:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff964549e63800 x1872792636105088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786034366.162264:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1872792636105088:0@lo:38: 00000100:00100000:2.0:1786034366.162336:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034366.162413:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636105088 00000100:00100000:1.0:1786034366.162426:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636105088 00000100:00100000:1.0:1786034366.162455:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786034366.162462:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1872792636105088:12345-0@lo:38: 00010000:00080000:1.0:1786034366.162483:0:5861:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:1.0:1786034366.162509:0:5861:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x490975051af3fa30 00000004:00100000:1.0:1786034366.162520:0:5861:0:(mdt_handler.c:7332:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786034366.162554:0:5861:0:(import.c:65:import_set_state_nolock()) ffff964548910000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1786034366.163194:0:6741:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1786034366.163682:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786034366.163694:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636105216:0@lo:400: 00000100:00100000:0.0:1786034366.163725:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034366.163758:0:5862:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1786034366.163766:0:5862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000040:00080000:3.0:1786034366.164100:0:6741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1786034366.164275:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636105216 00000100:00100000:0.0:1786034366.164280:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636105216 00000100:00100000:0.0:1786034366.164308:0:5862:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1786034366.164316:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786034366.164323:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636105216:12345-0@lo:400: 00000100:00100000:0.0:1786034366.164370:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636105216:12345-0@lo:400: Request processed in 47us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034366.164376:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1786034366.164408:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96455a5b3b80 x1872792636105216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034366.164536:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636105216:0@lo:400: 00000100:00100000:1.0:1786034366.165181:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872792636105088:12345-0@lo:38: Request processed in 2656us (2793us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.165197:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1786034366.165495:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff964549e63800 x1872792636105088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786034376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034366.165504:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786034366.165512:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1786034366.165518:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1786034366.165522:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1786034366.165525:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96444501e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1786034366.165530:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1872792636105088:0@lo:38: 00000020:01000000:3.0:1786034366.169933:0:6717:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1786034366.169968:0:6717:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786034366.169988:0:6717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa1b expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.169999:0:6717:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa1b expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1786034366.170046:0:6717:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1786034366.170049:0:6717:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1786034366.170050:0:6717:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786034366.170051:0:6717:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786034366.170052:0:6717:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786034366.170054:0:6717:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786034366.170055:0:6717:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786034366.170056:0:6717:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786034366.170062:0:6717:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786034366.170063:0:6717:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786034366.170064:0:6717:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1786034366.170068:0:6717:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1786034366.170070:0:6717:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786034366.170071:0:6717:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1786034366.170072:0:6717:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786034366.170073:0:6717:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786034366.170074:0:6717:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786034366.170075:0:6717:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786034366.170076:0:6717:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786034366.170077:0:6717:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786034366.170078:0:6717:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786034366.170079:0:6717:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786034366.170079:0:6717:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1786034366.170102:0:6717:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1786034366.175502:0:6717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636105344:0@lo:253: 00000100:00100000:3.0:1786034366.175646:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034366.175688:0:6717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c3780 going to sleep for 11 seconds 00000100:00100000:1.0:1786034366.175850:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636105344 00000100:00100000:1.0:1786034366.175858:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636105344 00000100:00100000:1.0:1786034366.175902:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1786034366.175911:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:6717:x1872792636105344:12345-0@lo:253: 20000000:01000000:1.0:1786034366.175937:0:5855:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1786034366.175949:0:5855:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1786034366.236082:0:5855:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1786034366.236098:0:5855:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1786034366.236218:0:5877:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1786034366.236223:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1786034366.236243:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034366.236262:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964540030e00/0x490975051af3f98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f988 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034366.236269:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034366.236312:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964540030e00/0x490975051af3f98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3f988 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034366.236326:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964540030e00/0x490975051af3f98f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3f988 expref: 13 pid: 5853 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034366.236339:0:5877:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f65f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1872792636105472:0@lo:104: 00000100:00100000:2.0:1786034366.236398:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034366.236641:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636105472 00000100:00100000:1.0:1786034366.236649:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636105472 00000100:00100000:1.0:1786034366.236694:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786034366.236703:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5877:x1872792636105472:12345-0@lo:104: 00010000:00010000:1.0:1786034366.236715:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964562313000/0x490975051af3f988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f98f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034366.236761:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786034366.236767:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5877:x1872792636105472:12345-0@lo:104: Request processed in 66us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034366.236773:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1786034366.236860:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034366.236867:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964562313000/0x490975051af3f988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f98f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.236879:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313000 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034366.236883:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964562313000/0x490975051af3f988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3f98f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.236891:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964562313000/0x490975051af3f988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3f98f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034366.236898:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964562313000/0x490975051af3f988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3f98f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034366.236903:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1786034366.236927:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964562313000/0x490975051af3f988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f98f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.236933:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034366.236947:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964562313000/0x490975051af3f988 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f98f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.236954:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964562313000/0x490975051af3f988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f98f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.236967:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034366.236969:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034366.236971:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034366.236990:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636105600:0@lo:103: 00000100:00100000:0.0:1786034366.237017:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034366.237074:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636105600 00000100:00100000:0.0:1786034366.237078:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636105600 00010000:00010000:0.0:1786034366.237093:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964540030e00/0x490975051af3f98f lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f988 expref: 14 pid: 5853 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034366.237280:0:5877:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c751540 going to sleep for 11 seconds 00000100:00100000:2.0:1786034366.237299:0:5877:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f65f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1872792636105472:0@lo:104: 00010000:00010000:2.0:1786034366.237641:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034366.238353:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786034366.238365:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a062c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:3309:x1872792636105600:12345-0@lo:103: 00010000:00010000:0.0:1786034366.238376:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034366.238382:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964540030e00/0x490975051af3f98f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f988 expref: 14 pid: 5853 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.238393:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964540030e00/0x490975051af3f98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3f988 expref: 14 pid: 5853 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.238406:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964540030e00/0x490975051af3f98f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3f988 expref: 14 pid: 5853 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.238428:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.238436:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786034366.238449:0:5848:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002227291s 00010000:00010000:0.0:1786034366.238453:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.238460:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.238467:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.238474:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.238488:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1200 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034366.238492:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.238500:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.238521:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034366.238531:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034366.238574:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a062c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:3309:x1872792636105600:12345-0@lo:103: Request processed in 212us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034366.238590:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786034366.238643:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636105600:0@lo:103: 00010000:00010000:3.0:1786034366.238866:0:5877:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.238875:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034366.238882:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f1200/0x490975051af3fa37 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034366.270776:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:6717:x1872792636105344:12345-0@lo:253: Request processed in 94859us (95125us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034366.270789:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786034366.270933:0:6717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6717:1872792636105344:0@lo:253: 10000000:01000000:3.0:1786034366.270947:0:6717:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1786034366.270950:0:6717:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1786034366.270952:0:6717:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1786034366.270953:0:6717:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786034366.270954:0:6717:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786034366.270955:0:6717:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786034366.270969:0:6717:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786034366.270970:0:6717:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786034366.270971:0:6717:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786034366.270972:0:6717:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786034366.270973:0:6717:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786034366.270975:0:6717:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1786034366.270987:0:6717:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1786034366.288439:0:6717:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1786034366.288639:0:6717:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1786034366.288852:0:6717:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1786034366.289033:0:6717:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1786034366.289257:0:6717:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1786034366.289481:0:6717:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1786034366.298019:0:6717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1786034366.691228:0:6717:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1786034366.691235:0:6717:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1786034366.691267:0:6717:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1786034366.691325:0:6717:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.156@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1786034366.691352:0:6717:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1786034366.691376:0:6717:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1786034367.093929:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034368.114014:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034369.136950:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034370.178756:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034371.184313:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034371.632175:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636105984:0@lo:400: 00000100:00100000:2.0:1786034371.632237:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034371.632289:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786034371.632295:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636105856:0@lo:400: 00000100:00100000:2.0:1786034371.632316:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034371.632389:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636105728:0@lo:400: 00000100:00100000:3.0:1786034371.632428:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034371.632476:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636105984 00000100:00100000:3.0:1786034371.632482:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636105984 00000100:00100000:3.0:1786034371.632525:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636105856 00000100:00100000:3.0:1786034371.632528:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636105856 00000100:00100000:3.0:1786034371.632543:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786034371.632550:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636105984:12345-0@lo:400: 00000100:00100000:3.0:1786034371.632590:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636105984:12345-0@lo:400: Request processed in 41us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034371.632597:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786034371.632610:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786034371.632615:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636105856:12345-0@lo:400: 00000100:00100000:3.0:1786034371.632635:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636105856:12345-0@lo:400: Request processed in 21us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034371.632640:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786034371.633055:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636105728 00000100:00100000:2.0:1786034371.633060:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636105728 00000100:00100000:2.0:1786034371.633087:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786034371.633094:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:3310:x1872792636105728:12345-0@lo:400: 00000100:00100000:2.0:1786034371.633130:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:3310:x1872792636105728:12345-0@lo:400: Request processed in 37us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034371.633135:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1786034371.633169:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034371.633199:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636105728:0@lo:400: 00010000:00080000:2.0:1786034371.633225:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964542f66a00 x1872792636105856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034371.633236:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636105856:0@lo:400: 00010000:00080000:2.0:1786034371.633244:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964542f64700 x1872792636105984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034371.633251:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636105984:0@lo:400: 00010000:00010000:1.0:1786034372.214090:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786034372.656111:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1786034372.656117:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff964559843800 from 21 10000000:01000000:0.0:1786034372.656122:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786034372.656172:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.656185:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.656210:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034372.656234:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636106112:0@lo:101: 00000100:00100000:0.0:1786034372.656296:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034372.656344:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964551224d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786034372.656368:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636106112 00000100:00100000:0.0:1786034372.656374:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636106112 00000100:00100000:0.0:1786034372.656417:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786034372.656425:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5858:x1872792636106112:12345-0@lo:101: 00010000:00010000:0.0:1786034372.656438:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034372.656449:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964540030200/0x490975051af3fa45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fa3e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.656470:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964540030200/0x490975051af3fa45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fa3e expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.656481:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964540030200/0x490975051af3fa45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fa3e expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.656489:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964540030200, rc 0) 00000100:00100000:0.0:1786034372.656523:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:5858:x1872792636106112:12345-0@lo:101: Request processed in 99us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034372.656529:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786034372.656570:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636106112:0@lo:101: 00010000:00010000:0.0:1786034372.656583:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.656600:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fa45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034372.656643:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636106240:0@lo:501: 00000100:00100000:0.0:1786034372.656666:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034372.656685:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964551224d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786034372.656839:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636106240 00000100:00100000:0.0:1786034372.656844:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636106240 00000100:00100000:0.0:1786034372.656867:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786034372.656873:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:5858:x1872792636106240:12345-0@lo:501: 00000100:00100000:0.0:1786034372.658249:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:5858:x1872792636106240:12345-0@lo:501: Request processed in 1373us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034372.658257:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1786034372.671982:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636106240:0@lo:501: 00000100:00100000:0.0:1786034372.672842:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636106368:0@lo:503: 00000100:00100000:0.0:1786034372.672914:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034372.672961:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964551224d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786034372.673856:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636106368 00000100:00100000:1.0:1786034372.673872:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636106368 00000100:00100000:1.0:1786034372.673918:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786034372.673928:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:5858:x1872792636106368:12345-0@lo:503: 00000100:00100000:1.0:1786034372.674422:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:5858:x1872792636106368:12345-0@lo:503: Request processed in 494us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034372.674431:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786034372.682868:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636106368:0@lo:503: 00000100:00100000:3.0:1786034372.684661:0:6953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6953:1872792636106496:0@lo:502: 00000100:00100000:3.0:1786034372.684957:0:6953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034372.685093:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636106496 00000100:00100000:2.0:1786034372.685100:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636106496 00000100:00100000:2.0:1786034372.685137:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1786034372.685146:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:6953:x1872792636106496:12345-0@lo:502: 00000100:00100000:2.0:1786034372.696359:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:6953:x1872792636106496:12345-0@lo:502: Request processed in 11205us (11393us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034372.696372:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786034372.698399:0:6953:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454f664c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786034372.698430:0:6953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6953:1872792636106496:0@lo:502: 00000100:00100000:3.0:1786034372.698497:0:6953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6953:1872792636106624:0@lo:502: 00000100:00100000:3.0:1786034372.698551:0:6953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034372.698578:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636106624 00000100:00100000:3.0:1786034372.698583:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636106624 00000100:00100000:3.0:1786034372.698619:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786034372.698626:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:6953:x1872792636106624:12345-0@lo:502: 00000100:00100000:3.0:1786034372.698852:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:6953:x1872792636106624:12345-0@lo:502: Request processed in 225us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034372.698860:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786034372.698890:0:6953:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454f664c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786034372.698902:0:6953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6953:1872792636106624:0@lo:502: 00000040:00080000:3.0:1786034372.698918:0:6953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1786034372.699108:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1786034372.699126:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786034372.699134:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034372.699164:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786034372.699172:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1786034372.699175:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff964559843800 from 4 10000000:01000000:2.0:1786034372.699177:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1786034372.699199:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034372.699206:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034372.699214:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034372.699225:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636106752:0@lo:101: 00000100:00100000:2.0:1786034372.699250:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034372.699277:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645595b76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034372.699581:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636106752 00000100:00100000:3.0:1786034372.699586:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636106752 00000100:00100000:3.0:1786034372.699615:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1786034372.699622:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:5858:x1872792636106752:12345-0@lo:101: 00010000:00010000:3.0:1786034372.699630:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034372.699643:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964562312a00/0x490975051af3fa53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fa4c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034372.699663:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964562312a00/0x490975051af3fa53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fa4c expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034372.699672:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964562312a00/0x490975051af3fa53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fa4c expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034372.699681:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312a00, rc 0) 00000100:00100000:3.0:1786034372.699814:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636106752:12345-0@lo:101: Request processed in 191us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034372.699864:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1786034372.707515:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636106752:0@lo:101: 00010000:00010000:0.0:1786034372.707543:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa53 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.707555:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fa53 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034372.707631:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636106880:0@lo:256: 00000100:00100000:0.0:1786034372.707702:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034372.707752:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636106880 00000100:00100000:0.0:1786034372.707758:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636106880 00000100:00100000:0.0:1786034372.707798:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786034372.707805:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636106880:12345-0@lo:256: 20000000:01000000:0.0:1786034372.707835:0:5855:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786034372.707849:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786034372.707852:0:5855:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1786034372.707922:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636106880:12345-0@lo:256: Request processed in 117us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034372.707930:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786034372.707968:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542f22240 going to sleep for 11 seconds 00000100:00100000:0.0:1786034372.707980:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636106880:0@lo:256: 10000000:01000000:0.0:1786034372.708018:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786034372.708024:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa53 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.708032:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa53 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034372.708040:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1786034372.708042:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1786034372.708044:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1786034372.708066:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.708073:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.708082:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034372.708100:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636107008:0@lo:101: 00000100:00100000:0.0:1786034372.708122:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034372.708141:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636107008 00000100:00100000:0.0:1786034372.708144:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636107008 00000100:00100000:0.0:1786034372.708174:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786034372.708179:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636107008:12345-0@lo:101: 00010000:00010000:0.0:1786034372.708187:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034372.708197:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964540030e00/0x490975051af3fa61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fa5a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.708212:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964540030e00/0x490975051af3fa61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fa5a expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.708221:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964540030e00/0x490975051af3fa61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fa5a expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.708228:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964540030e00, rc 0) 00000100:00100000:0.0:1786034372.708247:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636107008:12345-0@lo:101: Request processed in 68us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034372.708252:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786034372.708270:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542f22240 going to sleep for 11 seconds 00000100:00100000:0.0:1786034372.708279:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636107008:0@lo:101: 00010000:00010000:0.0:1786034372.708287:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.708293:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fa61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034372.708338:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636107136:0@lo:501: 00000100:00100000:0.0:1786034372.708358:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034372.708373:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636107136 00000100:00100000:0.0:1786034372.708376:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636107136 00000100:00100000:0.0:1786034372.708393:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1786034372.708397:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636107136:12345-0@lo:501: 00000100:00100000:0.0:1786034372.708587:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636107136:12345-0@lo:501: Request processed in 188us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034372.708593:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1786034372.708611:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542f22240 going to sleep for 11 seconds 00000100:00100000:0.0:1786034372.708620:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636107136:0@lo:501: 00000100:00100000:0.0:1786034372.708640:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636107264:0@lo:503: 00000100:00100000:0.0:1786034372.708673:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034372.708688:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636107264 00000100:00100000:0.0:1786034372.708691:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636107264 00000100:00100000:0.0:1786034372.708709:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786034372.708714:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636107264:12345-0@lo:503: 00000100:00100000:0.0:1786034372.708990:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636107264:12345-0@lo:503: Request processed in 274us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034372.708996:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786034372.709024:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542f22240 going to sleep for 11 seconds 00000100:00100000:0.0:1786034372.709035:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636107264:0@lo:503: 00000100:00100000:1.0:1786034372.718569:0:6954:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6954:1872792636107392:0@lo:502: 00000100:00100000:1.0:1786034372.718639:0:6954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034372.718678:0:6954:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034372.718727:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636107392 00000100:00100000:0.0:1786034372.718733:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636107392 00000100:00100000:0.0:1786034372.718784:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786034372.718793:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:6954:x1872792636107392:12345-0@lo:502: 00000100:00100000:0.0:1786034372.719088:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:6954:x1872792636107392:12345-0@lo:502: Request processed in 295us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034372.719096:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1786034372.719229:0:6954:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6954:1872792636107392:0@lo:502: 00000020:01000000:1.0:1786034372.719253:0:6954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786034372.719261:0:6954:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1786034372.719267:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034372.719269:0:6954:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1786034372.719273:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1786034372.719276:0:6954:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.156@tcp to nid 0x20000c0a8cb9c (192.168.203.156@tcp) 00000020:01000000:1.0:1786034372.719295:0:6954:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1786034372.719298:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786034372.719309:0:6954:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff964542f4b380) 00000020:00000080:1.0:1786034372.719326:0:6954:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1786034372.719330:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1786034372.719385:0:6954:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1786034372.719390:0:6954:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1786034372.719395:0:6954:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x490975051af3fa6f 00010000:00080000:1.0:1786034372.719419:0:6954:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96457645a800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.156@tcp at head 00010000:00010000:1.0:1786034372.719613:0:6954:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1786034372.853444:0:6954:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1786034372.853464:0:6954:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1786034372.855023:0:6954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786034372.857806:0:6954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786034372.857886:0:6954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1786034372.857966:0:6954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1786034372.858773:0:6972:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786034372.858779:0:6972:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1786034372.867015:0:6954:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786034372.867031:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1786034372.867068:0:6954:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1786034372.867088:0:6954:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x490975051af3fa76 00000100:00080000:2.0:1786034372.867099:0:6954:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786034372.867112:0:6954:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96457645a800 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:2.0:1786034372.867146:0:6954:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff964542f66a00 x1872792636107520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786034372.867176:0:6954:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1786034372.867228:0:6954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786034372.867232:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034372.867234:0:6954:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1786034372.867236:0:6954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786034372.867240:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034372.867241:0:6954:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786034372.867244:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786034372.867245:0:6954:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1786034372.869326:0:6954:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f65f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6954:1872792636107648:0@lo:502: 00000100:00100000:2.0:1786034372.869466:0:6954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034372.869518:0:6954:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645595b7240 going to sleep for 11 seconds 00000100:00100000:2.0:1786034372.869555:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636107520:0@lo:8: 00000100:00100000:2.0:1786034372.869587:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034372.869652:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636107904:0@lo:400: 00000100:00100000:2.0:1786034372.869678:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034372.869696:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786034372.870791:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636107648 00000100:00100000:0.0:1786034372.870799:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636107648 00000100:00100000:0.0:1786034372.870850:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1786034372.870859:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:6954:x1872792636107648:12345-0@lo:502: 00000100:00100000:0.0:1786034372.871085:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:6954:x1872792636107648:12345-0@lo:502: Request processed in 227us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034372.871093:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1786034372.871166:0:6954:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f65f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:6954:1872792636107648:0@lo:502: 00000020:01000000:0.0:1786034372.871193:0:6954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034372.871200:0:6954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034372.871202:0:6954:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1786034372.871207:0:6954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1786034372.871325:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1786034372.871343:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1786034372.871352:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.871362:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034372.871385:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1786034372.871387:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff964542f499c0 from 1 10000000:01000000:0.0:1786034372.871390:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1786034372.871421:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.871429:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.871437:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034372.871453:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636108032:0@lo:101: 00000100:00100000:0.0:1786034372.871481:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034372.871498:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542f22a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786034372.871515:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636108032 00000100:00100000:0.0:1786034372.871518:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636108032 00000100:00100000:0.0:1786034372.871539:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1786034372.871545:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636108032:12345-0@lo:101: 00010000:00010000:0.0:1786034372.871553:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034372.871564:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964540031200/0x490975051af3fa84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fa7d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.871585:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964540031200/0x490975051af3fa84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fa7d expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.871594:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964540031200/0x490975051af3fa84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fa7d expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.871601:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964540031200, rc 0) 00000100:00100000:0.0:1786034372.871629:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636108032:12345-0@lo:101: Request processed in 84us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034372.871635:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1786034372.871671:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636108032:0@lo:101: 00010000:00010000:0.0:1786034372.871682:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa84 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.871690:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fa84 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034372.871776:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636107776:0@lo:400: 00000100:00100000:2.0:1786034372.871810:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034372.873907:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636107520 00000100:00100000:3.0:1786034372.873916:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636107520 00000100:00100000:3.0:1786034372.873946:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786034372.873953:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1872792636107520:12345-0@lo:8: 00010000:00080000:3.0:1786034372.873987:0:6719:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:3.0:1786034372.874015:0:6719:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x490975051af3fa8b 00002000:00100000:3.0:1786034372.874049:0:6719:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96457d443000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113834 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1786034372.874053:0:6719:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1786034372.874057:0:6719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1786034372.874170:0:6719:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1786034372.874310:0:6719:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1786034372.874332:0:6719:0:(import.c:65:import_set_state_nolock()) ffff96457d445000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786034372.874393:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1872792636107520:12345-0@lo:8: Request processed in 439us (4805us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034372.874401:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786034372.874423:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636107904 00000100:00100000:3.0:1786034372.874427:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636107904 00000100:00100000:3.0:1786034372.874454:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636107776 00000100:00100000:3.0:1786034372.874457:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636107776 00000100:00100000:3.0:1786034372.874480:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786034372.874486:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636107904:12345-0@lo:400: 00010000:00080000:2.0:1786034372.874504:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964542f66a00 x1872792636107520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786034382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034372.874517:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786034372.874525:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00100000:3.0:1786034372.874526:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636107904:12345-0@lo:400: Request processed in 39us (4847us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034372.874536:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1786034372.874536:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1786034372.874542:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1786034372.874555:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96457645a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1786034372.874557:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786034372.874566:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636107776:12345-0@lo:400: 00000004:00080000:2.0:1786034372.874572:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1786034372.874580:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636107520:0@lo:8: 00000100:00100000:3.0:1786034372.874597:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636107776:12345-0@lo:400: Request processed in 31us (2786us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034372.874603:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1786034372.874741:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964542f67800 x1872792636107776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034372.874752:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636107776:0@lo:400: 00010000:00080000:3.0:1786034372.874765:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964542f67480 x1872792636107904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034372.874773:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636107904:0@lo:400: 00000004:00080000:3.0:1786034372.874793:0:6972:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1786034372.874913:0:6972:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 209083088860ns, next at 0ns, rc = 0 00000100:00100000:0.0:1786034372.879516:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636108160:0@lo:501: 00000100:00100000:0.0:1786034372.879569:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034372.879601:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542f22a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786034372.879623:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636108160 00000100:00100000:0.0:1786034372.879628:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636108160 00000100:00100000:0.0:1786034372.879662:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786034372.879670:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636108160:12345-0@lo:501: 00000100:00100000:0.0:1786034372.879866:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636108160:12345-0@lo:501: Request processed in 196us (295us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786034372.879873:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786034372.879914:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636108160:0@lo:501: 10000000:01000000:0.0:1786034372.879938:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1786034372.879946:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa84 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034372.879956:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fa84 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786034372.993715:0:6973:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1786034372.993745:0:6973:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f65c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6973:1872792636108416:0@lo:7: 00000100:00100000:2.0:1786034372.993805:0:6973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034372.993866:0:6973:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645595b76c0 going to sleep for 11 seconds 00000004:00080000:2.0:1786034372.993892:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1786034372.993917:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636108288:0@lo:13: 00000100:00100000:2.0:1786034372.993944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034372.993985:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636108288 00000100:00100000:2.0:1786034372.993992:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636108288 00000100:00100000:2.0:1786034372.994039:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786034372.994048:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636108288:12345-0@lo:13: 00002000:00000024:2.0:1786034372.994076:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1786034372.994117:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636108288:12345-0@lo:13: Request processed in 70us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034372.994124:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1786034372.994143:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786034372.994181:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964542f66a00 x1872792636108288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034372.994199:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636108288:0@lo:13: 00000100:00100000:3.0:1786034372.994311:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636108416 00000100:00100000:3.0:1786034372.994316:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636108416 00000100:00100000:3.0:1786034372.994351:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786034372.994358:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6973:x1872792636108416:12345-0@lo:7: 00002000:00080000:0.0:1786034373.017947:0:6721:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1786034373.017955:0:6721:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1786034373.019833:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6973:x1872792636108416:12345-0@lo:7: Request processed in 25461us (26014us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034373.019854:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1786034373.022282:0:6973:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964542f65c00 x1872792636108416/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1786034388 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034373.022299:0:6973:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f65c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6973:1872792636108416:0@lo:7: 00000004:00080000:2.0:1786034373.022313:0:6973:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1786034373.022358:0:6973:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f65c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6973:1872792636108544:0@lo:5: 00000100:00100000:2.0:1786034373.022795:0:6973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034373.022894:0:6973:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645595b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034373.030463:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636108544 00000100:00100000:0.0:1786034373.030476:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636108544 00000100:00100000:0.0:1786034373.030533:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786034373.030543:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6973:x1872792636108544:12345-0@lo:5: 00002000:00080000:0.0:1786034373.030574:0:6720:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1786034373.030578:0:6720:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1786034373.030989:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6973:x1872792636108544:12345-0@lo:5: Request processed in 448us (8194us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1786034373.030997:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1786034373.031815:0:6973:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964542f65c00 x1872792636108544/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786034389 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034373.031849:0:6973:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f65c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6973:1872792636108544:0@lo:5: 00000004:00080000:2.0:1786034373.031862:0:6973:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1786034373.031896:0:6973:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6973:1872792636108672:0@lo:700: 00000100:00100000:2.0:1786034373.031931:0:6973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034373.031963:0:6973:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645595b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034373.032785:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636108672 00000100:00100000:0.0:1786034373.032790:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636108672 00000100:00100000:0.0:1786034373.032833:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786034373.032841:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6973:x1872792636108672:12345-0@lo:700: 00000100:00100000:0.0:1786034373.032871:0:6728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6728:1872792636108800:0@lo:700: 00000100:00100000:0.0:1786034373.032900:0:6728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034373.032922:0:6728:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645595c9180 going to sleep for 11 seconds 00000100:00100000:2.0:1786034373.033790:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636108800 00000100:00100000:2.0:1786034373.033795:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636108800 00000100:00100000:2.0:1786034373.033994:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786034373.034001:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6728:x1872792636108800:12345-0@lo:700: 00000100:00080000:3.0:1786034373.043981:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:1.0:1786034373.109484:0:5868:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1786034373.125595:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6728:x1872792636108800:12345-0@lo:700: Request processed in 91587us (92685us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034373.125625:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1786034373.134848:0:6728:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96455a5b2680 x1872792636108800/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1786034389 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034373.134868:0:6728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6728:1872792636108800:0@lo:700: 40000000:02000000:3.0:1786034373.134884:0:6728:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:1.0:1786034373.232798:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786034373.363071:0:6746:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1786034373.363108:0:6746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1786034373.363937:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6973:x1872792636108672:12345-0@lo:700: Request processed in 331092us (332001us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034373.363964:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1786034373.367490:0:6973:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964542f64380 x1872792636108672/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1786034389 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034373.367505:0:6973:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1786034373.367525:0:6973:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6973:1872792636108672:0@lo:700: 00000004:02000040:2.0:1786034373.495776:0:6973:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1786034373.504189:0:6973:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6973:1872792636108928:0@lo:5: 00000100:00100000:2.0:1786034373.504254:0:6973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034373.504317:0:6973:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645595b7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786034373.509226:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636108928 00000100:00100000:3.0:1786034373.509237:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636108928 00000100:00100000:3.0:1786034373.509293:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786034373.509302:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6973:x1872792636108928:12345-0@lo:5: 00002000:00080000:3.0:1786034373.525794:0:6721:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1786034373.525813:0:6721:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00010000:00080000:0.0:1786034373.541229:0:6973:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964542f64380 x1872792636108928/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786034389 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034373.541249:0:6973:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6973:1872792636108928:0@lo:5: 00000004:00080000:0.0:1786034373.541263:0:6973:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000100:00100000:3.0:1786034373.541440:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6973:x1872792636108928:12345-0@lo:5: Request processed in 31197us (36244us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1786034373.541452:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1786034374.255958:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034375.281615:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786034376.100105:0:7093:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1786034376.303953:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034377.336953:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034378.288761:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636109184:0@lo:400: 00000100:00100000:1.0:1786034378.288847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034378.288895:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786034378.288901:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636109312:0@lo:400: 00000100:00100000:1.0:1786034378.288939:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034378.288972:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636109184 00000100:00100000:1.0:1786034378.288979:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636109184 00000100:00100000:1.0:1786034378.289018:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786034378.289026:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3309:x1872792636109184:12345-0@lo:400: 00000100:00100000:1.0:1786034378.289075:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3309:x1872792636109184:12345-0@lo:400: Request processed in 49us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034378.289082:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786034378.289135:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636109184:0@lo:400: 00000100:00100000:2.0:1786034378.289718:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636109056:0@lo:13: 00000100:00100000:2.0:1786034378.289755:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034378.289780:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636109568:0@lo:400: 00000100:00100000:2.0:1786034378.289840:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034378.289858:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786034378.289864:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636109440:0@lo:400: 00000100:00100000:2.0:1786034378.289897:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034378.290496:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636109312 00000100:00100000:3.0:1786034378.290501:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636109312 00000100:00100000:3.0:1786034378.291455:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636109440 00000100:00100000:3.0:1786034378.291461:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636109440 00000100:00100000:3.0:1786034378.291491:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786034378.291499:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636109312:12345-0@lo:400: 00000100:00100000:1.0:1786034378.291669:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636109056 00000100:00100000:1.0:1786034378.291673:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636109056 00000100:00100000:1.0:1786034378.291707:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786034378.291714:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1872792636109056:12345-0@lo:13: 00002000:00000024:1.0:1786034378.291740:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034378.291806:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1872792636109056:12345-0@lo:13: Request processed in 92us (2049us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034378.291812:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786034378.292518:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636109312:12345-0@lo:400: Request processed in 1009us (3567us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034378.292526:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786034378.292540:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786034378.292546:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636109440:12345-0@lo:400: 00000100:00100000:3.0:1786034378.292571:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636109440:12345-0@lo:400: Request processed in 26us (2673us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034378.292576:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786034378.292594:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636109568 00000100:00100000:3.0:1786034378.292598:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636109568 00000100:00100000:3.0:1786034378.292620:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786034378.292626:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1872792636109568:12345-0@lo:400: 00000100:00100000:3.0:1786034378.292664:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1872792636109568:12345-0@lo:400: Request processed in 38us (2842us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034378.292670:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1786034378.292762:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786034378.292766:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786034378.297677:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96457d1c0000 x1872792636109440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034378.297694:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636109440:0@lo:400: 00010000:00080000:1.0:1786034378.301714:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96457d1c1c00 x1872792636109312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034378.301731:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636109312:0@lo:400: 00010000:00080000:1.0:1786034378.301770:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96455a5b3800 x1872792636109056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034378.301788:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636109056:0@lo:13: 00010000:00080000:1.0:1786034378.305178:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96457d1c3b80 x1872792636109568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034378.305195:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636109568:0@lo:400: 00010000:00010000:1.0:1786034378.353999:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786034378.383837:0:6746:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1786034379.376075:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034380.400038:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034381.425236:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034382.454917:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034383.408405:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636109696:0@lo:13: 00000100:00100000:3.0:1786034383.408477:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034383.408503:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636109952:0@lo:400: 00000100:00100000:3.0:1786034383.408542:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636110208:0@lo:400: 00000100:00100000:0.0:1786034383.408544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034383.408571:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034383.408584:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786034383.408593:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636110080:0@lo:400: 00000100:00100000:3.0:1786034383.408611:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034383.408620:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636109824:0@lo:400: 00000100:00100000:0.0:1786034383.408624:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034383.408657:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034383.408690:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636109824 00000100:00100000:0.0:1786034383.408698:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636109824 00000100:00100000:3.0:1786034383.408702:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636109952 00000100:00100000:3.0:1786034383.408707:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636109952 00000100:00100000:0.0:1786034383.408743:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786034383.408745:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636110080 00000100:00100000:3.0:1786034383.408750:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636110080 00000100:00100000:0.0:1786034383.408754:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3309:x1872792636109824:12345-0@lo:400: 00000100:00100000:3.0:1786034383.408796:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786034383.408805:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636109952:12345-0@lo:400: 00000100:00100000:0.0:1786034383.408807:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3309:x1872792636109824:12345-0@lo:400: Request processed in 54us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034383.408817:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786034383.408877:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636109952:12345-0@lo:400: Request processed in 72us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034383.408884:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1786034383.408901:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964574eb4e00 x1872792636109952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034383.408903:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786034383.408915:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636110080:12345-0@lo:400: 00000100:00100000:0.0:1786034383.408921:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636109952:0@lo:400: 00000100:00100000:3.0:1786034383.408984:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636110080:12345-0@lo:400: Request processed in 42us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034383.408992:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1786034383.409059:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964574eb4a80 x1872792636110080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034383.409060:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636110208 00000100:00100000:3.0:1786034383.409079:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636110208 00000100:00100000:0.0:1786034383.409081:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636110080:0@lo:400: 00000100:00100000:2.0:1786034383.409137:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636109696 00000100:00100000:2.0:1786034383.409142:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636109696 00000100:00100000:3.0:1786034383.409160:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786034383.409176:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786034383.409185:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636109696:12345-0@lo:13: 00000100:00100000:3.0:1786034383.409190:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636110208:12345-0@lo:400: 00002000:00000024:2.0:1786034383.409213:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034383.409253:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636110208:12345-0@lo:400: Request processed in 85us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034383.409259:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636109696:12345-0@lo:13: Request processed in 75us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034383.409266:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786034383.409270:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1786034383.409385:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786034383.409391:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034383.409413:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636109824:0@lo:400: 00010000:00080000:3.0:1786034383.409425:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964574eb5f80 x1872792636110208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034383.409433:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1786034383.409442:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636110208:0@lo:400: 00010000:00080000:3.0:1786034383.409453:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96455a5b3480 x1872792636109696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034383.409465:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636109696:0@lo:13: 00010000:00010000:2.0:1786034383.476137:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034384.496015:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034385.522362:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034386.555596:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034387.569066:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034388.529210:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636110336:0@lo:13: 00000100:00100000:3.0:1786034388.529364:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636110720:0@lo:400: 00000100:00100000:3.0:1786034388.529409:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034388.529456:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034388.529461:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636110848:0@lo:400: 00000100:00100000:3.0:1786034388.529492:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034388.529521:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636110464:0@lo:400: 00000100:00100000:3.0:1786034388.529546:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034388.529578:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786034388.529583:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636110592:0@lo:400: 00000100:00100000:3.0:1786034388.529601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034388.529626:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636110720 00000100:00100000:3.0:1786034388.529645:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636110720 00000100:00100000:3.0:1786034388.529684:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636110592 00000100:00100000:3.0:1786034388.529687:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636110592 00000100:00100000:3.0:1786034388.529703:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786034388.529710:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636110720:12345-0@lo:400: 00000100:00100000:3.0:1786034388.529766:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636110720:12345-0@lo:400: Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034388.529773:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786034388.529789:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786034388.529795:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636110592:12345-0@lo:400: 00000100:00100000:3.0:1786034388.529851:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636110592:12345-0@lo:400: Request processed in 57us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034388.529857:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786034388.529872:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636110848 00000100:00100000:3.0:1786034388.529876:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636110848 00000100:00100000:3.0:1786034388.529900:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786034388.529906:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636110848:12345-0@lo:400: 00000100:00100000:3.0:1786034388.529935:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636110848:12345-0@lo:400: Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034388.529941:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786034388.529957:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636110464 00000100:00100000:3.0:1786034388.529961:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636110464 00000100:00100000:3.0:1786034388.529984:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786034388.529990:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3307:x1872792636110464:12345-0@lo:400: 00000100:00100000:3.0:1786034388.530039:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3307:x1872792636110464:12345-0@lo:400: Request processed in 49us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034388.530045:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1786034388.530071:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786034388.530075:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1786034388.530103:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964549e62a00 x1872792636110848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034388.530116:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636110848:0@lo:400: 00010000:00080000:3.0:1786034388.530127:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964549e62d80 x1872792636110720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034388.530135:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636110720:0@lo:400: 00010000:00080000:3.0:1786034388.530160:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964549e61f80 x1872792636110592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034388.530169:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636110592:0@lo:400: 00000100:00100000:3.0:1786034388.530176:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636110464:0@lo:400: 00000100:00100000:2.0:1786034388.530505:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034388.532334:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636110336 00000100:00100000:3.0:1786034388.532342:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636110336 00000100:00100000:3.0:1786034388.532385:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786034388.532394:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636110336:12345-0@lo:13: 00002000:00000024:3.0:1786034388.532423:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034388.532481:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636110336:12345-0@lo:13: Request processed in 88us (1975us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034388.532488:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1786034388.532521:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964574eb6d80 x1872792636110336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034388.532543:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636110336:0@lo:13: 00010000:00010000:3.0:1786034388.595417:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034389.616184:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034390.640763:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1786034390.961532:0:7664:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1786034390.961536:0:7664:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1786034390.961659:0:7664:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff96457642c000 00000020:01000004:2.0:1786034390.961675:0:7664:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1786034390.961686:0:7664:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1786034390.961697:0:7664:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9645595e3380) 00000020:00000080:2.0:1786034390.961711:0:7664:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1786034391.025713:0:7664:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1786034391.027922:0:7664:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1786034391.117419:0:7664:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1786034391.137195:0:7664:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786034391.137229:0:7664:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1786034391.138893:0:7664:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1786034391.138922:0:7664:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1786034391.139232:0:7664:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1786034391.139243:0:7664:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786034391.141335:0:7664:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x490975051af3fa99 00000020:01000004:3.0:1786034391.141348:0:7664:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1786034391.147693:0:7664:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.156@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1786034391.147700:0:7664:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1786034391.147771:0:7664:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1786034391.147818:0:7664:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1786034391.147880:0:7664:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.156@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1786034391.231499:0:7664:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786034391.231539:0:7664:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.156@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1786034391.231543:0:7664:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786034391.231544:0:7664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786034391.231545:0:7664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034391.231546:0:7664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786034391.231551:0:7664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034391.231553:0:7664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034391.231554:0:7664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786034391.231556:0:7664:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786034391.231557:0:7664:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786034391.231558:0:7664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034391.231559:0:7664:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786034391.231563:0:7664:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1786034391.231565:0:7664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786034391.231567:0:7664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786034391.231568:0:7664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034391.231569:0:7664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786034391.231569:0:7664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034391.231571:0:7664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034391.231571:0:7664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786034391.231572:0:7664:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786034391.231573:0:7664:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786034391.231574:0:7664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034391.231575:0:7664:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786034391.231599:0:7664:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1786034391.231616:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636110976:0@lo:253: 00000100:00100000:2.0:1786034391.231681:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034391.231731:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c6eecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034391.231861:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636110976 00000100:00100000:1.0:1786034391.231869:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636110976 00000100:00100000:1.0:1786034391.231914:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786034391.231923:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:7664:x1872792636110976:12345-0@lo:253: 20000000:01000000:1.0:1786034391.231950:0:5853:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1786034391.231954:0:5853:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1786034391.231959:0:5853:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1786034391.231962:0:5853:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1786034391.232868:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786034391.233086:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1786034391.233099:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1786034391.233134:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1786034391.233149:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1786034391.233186:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1786034391.233231:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1786034391.233578:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1786034391.233594:0:5853:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.156@tcp 20000000:01000000:1.0:1786034391.233596:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.156@tcp (null) (null) (null) 00000040:00080000:1.0:1786034391.233627:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1786034391.233635:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1786034391.233682:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1786034391.233691:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.156@tcp (null) (null) 00000040:00080000:1.0:1786034391.233723:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1786034391.233731:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1786034391.233761:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1786034391.233812:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1786034391.234525:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1786034391.234539:0:5853:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.156@tcp 20000000:01000000:1.0:1786034391.234540:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.156@tcp (null) (null) (null) 00000040:00080000:1.0:1786034391.234571:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1786034391.234578:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1786034391.234607:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1786034391.234614:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.156@tcp (null) (null) 00000040:00080000:1.0:1786034391.234644:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1786034391.234652:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1786034391.234694:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1786034391.234729:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1786034391.234745:0:5853:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1786034391.234748:0:5853:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1786034391.234751:0:5853:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1786034391.234762:0:5853:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1786034391.234765:0:5853:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1786034391.234794:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1786034391.234796:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1786034391.241360:0:7666:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1786034391.241444:0:7666:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1786034391.241495:0:7666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1786034391.245407:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1786034391.245457:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1786034391.245512:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1786034391.245525:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1786034391.245527:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1786034391.246371:0:7667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1786034391.246587:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1786034391.246622:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1786034391.246671:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1786034391.246682:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1786034391.246684:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1786034391.252183:0:7668:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1786034391.252263:0:7668:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1786034391.252315:0:7668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1786034391.252577:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1786034391.252614:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1786034391.252663:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1786034391.252677:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1786034391.252680:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1786034391.254019:0:7669:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1786034391.254096:0:7669:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1786034391.254127:0:7669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1786034391.254341:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1786034391.254381:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1786034391.254435:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1786034391.254451:0:5853:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1786034391.254453:0:5853:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1786034391.254461:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786034391.254479:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.254496:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9645413f1c00/0x490975051af3f9f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f9ea expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.254505:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964562313c00/0x490975051af3fa1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fa14 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.254513:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964540030200/0x490975051af3fa45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fa3e expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.254520:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964540030e00/0x490975051af3fa61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fa5a expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.254527:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964540031200/0x490975051af3fa84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fa7d expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.254547:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.254583:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964540031200/0x490975051af3fa84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fa7d expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.254597:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964540031200/0x490975051af3fa84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fa7d expref: 16 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034391.254611:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1872792636111104:0@lo:104: 00000100:00100000:1.0:1786034391.254668:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786034391.254718:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964540030e00/0x490975051af3fa61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fa5a expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.254726:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964540030e00/0x490975051af3fa61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fa5a expref: 16 pid: 5856 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034391.254734:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1872792636111232:0@lo:104: 00000100:00100000:3.0:1786034391.254741:0:5844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1786034391.254756:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964540030200/0x490975051af3fa45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fa3e expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034391.254757:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786034391.254764:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964540030200/0x490975051af3fa45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fa3e expref: 16 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034391.254771:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1872792636111360:0@lo:104: 00000100:00100000:1.0:1786034391.254792:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786034391.254808:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964562313c00/0x490975051af3fa1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fa14 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034391.254865:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636111104 00000100:00100000:2.0:1786034391.254872:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636111104 00000100:00100000:2.0:1786034391.254899:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636111232 00000100:00100000:2.0:1786034391.254902:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636111232 00000100:00100000:2.0:1786034391.254920:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636111360 00000100:00100000:2.0:1786034391.254923:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636111360 00000100:00100000:2.0:1786034391.254936:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786034391.254943:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96456c002850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+5:5853:x1872792636111104:12345-0@lo:104: 00010000:00010000:2.0:1786034391.254954:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fa84 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.255017:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786034391.255023:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96456c002850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+5:5853:x1872792636111104:12345-0@lo:104: Request processed in 81us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034391.255030:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1786034391.255035:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034391.255041:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fa84 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.255047:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964540031c00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:3.0:1786034391.255051:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fa84 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.255059:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fa84 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034391.255063:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786034391.255069:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+4:5853:x1872792636111232:12345-0@lo:104: 00010000:00010000:2.0:1786034391.255076:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fa61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786034391.255077:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fa84 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034391.255083:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786034391.255105:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1786034391.255109:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa84 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034391.255110:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+4:5853:x1872792636111232:12345-0@lo:104: Request processed in 42us (353us total) trans 0 rc 0/0 00010000:00010000:3.0:1786034391.255116:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1786034391.255116:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786034391.255128:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1786034391.255129:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa84 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034391.255134:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5853:x1872792636111360:12345-0@lo:104: 00010000:00010000:3.0:1786034391.255136:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964540031c00/0x490975051af3fa7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa84 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.255140:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fa45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.255146:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034391.255149:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fa61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.255154:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964540030c00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:3.0:1786034391.255157:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fa61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.255161:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1786034391.255164:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fa61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034391.255165:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5853:x1872792636111360:12345-0@lo:104: Request processed in 33us (373us total) trans 0 rc 0/0 10000000:00010000:3.0:1786034391.255171:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fa61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034391.255176:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1786034391.255181:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1786034391.255193:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.255194:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034391.255199:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786034391.255204:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.255210:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964540030c00/0x490975051af3fa5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.255220:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034391.255222:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034391.255224:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034391.255243:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636111616:0@lo:103: 00000100:00100000:3.0:1786034391.255328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034391.255357:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786034391.255363:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636111744:0@lo:103: 00000100:00100000:3.0:1786034391.255380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034391.255412:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636111616 00000100:00100000:3.0:1786034391.255416:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636111616 00000100:00100000:2.0:1786034391.255419:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636111744 00000100:00100000:2.0:1786034391.255422:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636111744 00010000:00010000:3.0:1786034391.255432:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964540031200/0x490975051af3fa84 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fa7d expref: 18 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.255432:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964540030e00/0x490975051af3fa61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fa5a expref: 18 pid: 5856 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034391.255460:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786034391.255466:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:3307:x1872792636111744:12345-0@lo:103: 00010000:00010000:2.0:1786034391.255475:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034391.255481:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964540030e00/0x490975051af3fa61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fa5a expref: 18 pid: 5856 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034391.258020:0:5847:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1786034391.258034:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1786034391.258210:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786034391.258220:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:3307:x1872792636111616:12345-0@lo:103: 00010000:00010000:3.0:1786034391.258234:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034391.258241:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964540031200/0x490975051af3fa84 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fa7d expref: 18 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.259093:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964562313c00/0x490975051af3fa1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fa14 expref: 18 pid: 5853 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034391.259107:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1872792636111488:0@lo:104: 00000100:00100000:1.0:1786034391.259164:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034391.259238:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636111488 00000100:00100000:0.0:1786034391.259244:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636111488 00000100:00100000:0.0:1786034391.259279:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1786034391.259286:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5853:x1872792636111488:12345-0@lo:104: 00010000:00010000:0.0:1786034391.259297:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fa1b expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.259338:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786034391.259344:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5853:x1872792636111488:12345-0@lo:104: Request processed in 59us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034391.259351:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1786034391.263088:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964540030e00/0x490975051af3fa61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fa5a expref: 18 pid: 5856 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.263117:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034391.263232:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:3307:x1872792636111744:12345-0@lo:103: Request processed in 7763us (7848us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034391.263242:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786034391.263292:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636111744:0@lo:103: 00010000:00010000:0.0:1786034391.263440:0:7670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034391.263447:0:7670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fa1b expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.263456:0:7670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964540031400 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034391.263460:0:7670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fa1b expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.263469:0:7670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fa1b expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034391.263475:0:7670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fa1b expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034391.263497:0:7670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786034391.263538:0:7670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa1b expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.263545:0:7670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034391.263559:0:7670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa1b expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.263567:0:7670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964540031400/0x490975051af3fa14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa1b expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.263579:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034391.263580:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034391.263582:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034391.266714:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034391.267111:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fa45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.267124:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964540031600 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:2.0:1786034391.267127:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fa45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.267146:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fa45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786034391.267153:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fa45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786034391.267158:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786034391.267188:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.267194:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786034391.267204:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.267211:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964540031600/0x490975051af3fa3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa45 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.267224:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034391.267226:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034391.267227:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034391.267594:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964540031200/0x490975051af3fa84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fa7d expref: 17 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.267620:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034391.267652:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636111872:0@lo:103: 00000100:00100000:3.0:1786034391.267715:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034391.267758:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034391.267764:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636112000:0@lo:103: 00000100:00100000:3.0:1786034391.267799:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034391.267842:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636111872 00000100:00100000:3.0:1786034391.267848:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636111872 00010000:00010000:3.0:1786034391.267868:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964562313c00/0x490975051af3fa1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fa14 expref: 18 pid: 5853 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034391.267886:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636112000 00000100:00100000:3.0:1786034391.267888:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636112000 00010000:00010000:3.0:1786034391.267897:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964540030200/0x490975051af3fa45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fa3e expref: 19 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034391.267908:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786034391.267915:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636111872:12345-0@lo:103: 00010000:00010000:3.0:1786034391.267925:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034391.267930:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964562313c00/0x490975051af3fa1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fa14 expref: 19 pid: 5853 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.267937:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964562313c00/0x490975051af3fa1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fa14 expref: 19 pid: 5853 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.267946:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034391.267978:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636111872:12345-0@lo:103: Request processed in 63us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034391.267985:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786034391.268024:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636111872:0@lo:103: 00000100:00100000:3.0:1786034391.268043:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786034391.268049:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:3309:x1872792636112000:12345-0@lo:103: 00010000:00010000:3.0:1786034391.268056:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034391.268060:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964540030200/0x490975051af3fa45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fa3e expref: 18 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.268069:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964540030200/0x490975051af3fa45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fa3e expref: 18 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.268078:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034391.268100:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:3309:x1872792636112000:12345-0@lo:103: Request processed in 52us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034391.268106:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786034391.268123:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636112000:0@lo:103: 00000100:00100000:3.0:1786034391.268154:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:3307:x1872792636111616:12345-0@lo:103: Request processed in 9937us (12826us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034391.268160:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786034391.271410:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636111616:0@lo:103: 00010000:00010000:1.0:1786034391.271553:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9645413f1c00/0x490975051af3f9f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3f9ea expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.271571:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9645413f1c00/0x490975051af3f9f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3f9ea expref: 16 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034391.271585:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1872792636112128:0@lo:104: 00000100:00100000:1.0:1786034391.271638:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034391.271682:0:5853:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560a95780 going to sleep for 11 seconds 00010000:00010000:1.0:1786034391.271696:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964540031200/0x490975051af3fa84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fa7d expref: 16 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034391.271707:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1872792636111104:0@lo:104: 00010000:00010000:1.0:1786034391.271717:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964540030e00/0x490975051af3fa61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fa5a expref: 15 pid: 5856 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034391.271726:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1872792636111232:0@lo:104: 00010000:00010000:1.0:1786034391.271735:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964540030200/0x490975051af3fa45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fa3e expref: 14 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034391.271742:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1872792636111360:0@lo:104: 00010000:00010000:1.0:1786034391.271752:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964562313c00/0x490975051af3fa1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fa14 expref: 13 pid: 5853 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034391.271773:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1872792636111488:0@lo:104: 00000100:00100000:3.0:1786034391.271956:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636112128 00000100:00100000:3.0:1786034391.271963:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636112128 00000100:00100000:3.0:1786034391.272016:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786034391.272026:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5853:x1872792636112128:12345-0@lo:104: 00010000:00010000:3.0:1786034391.272038:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f9f1 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.272104:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786034391.272111:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5853:x1872792636112128:12345-0@lo:104: Request processed in 87us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034391.272119:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1786034391.272184:0:7670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034391.272191:0:7670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f9f1 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.272199:0:7670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313600 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034391.272203:0:7670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3f9f1 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.272211:0:7670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3f9f1 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034391.272218:0:7670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3f9f1 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034391.272225:0:7670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786034391.272262:0:7670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f9f1 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.272269:0:7670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034391.272291:0:7670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f9f1 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.272297:0:7670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964562313600/0x490975051af3f9ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f9f1 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.272310:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034391.272312:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034391.272313:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034391.272351:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636112256:0@lo:103: 00000100:00100000:2.0:1786034391.272380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034391.272812:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636112256 00000100:00100000:0.0:1786034391.272816:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636112256 00010000:00010000:0.0:1786034391.272870:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9645413f1c00/0x490975051af3f9f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f9ea expref: 13 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034391.272894:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786034391.272900:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:3307:x1872792636112256:12345-0@lo:103: 00010000:00010000:0.0:1786034391.272909:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034391.272914:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9645413f1c00/0x490975051af3f9f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f9ea expref: 13 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.272923:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9645413f1c00/0x490975051af3f9f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3f9ea expref: 13 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.272938:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.272945:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.272966:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.272973:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.272980:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.272986:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.272991:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964541653e00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034391.272994:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.273010:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.273019:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.273029:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034391.273061:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:3307:x1872792636112256:12345-0@lo:103: Request processed in 162us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034391.273068:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786034391.273140:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636112256:0@lo:103: 00010000:00010000:1.0:1786034391.273235:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f1c00/0x490975051af3f9f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3f9ea expref: 12 pid: 5855 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034391.273246:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1872792636112128:0@lo:104: 00010000:00010000:1.0:1786034391.273268:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.273277:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.273282:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.273288:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964541653e00/0x490975051af3faa0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786034391.273299:0:5853:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1786034391.479377:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:7664:x1872792636110976:12345-0@lo:253: Request processed in 247439us (247682us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034391.479391:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1786034391.479539:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636110976:0@lo:253: 10000000:01000000:2.0:1786034391.479553:0:7664:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1786034391.479556:0:7664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786034391.479573:0:7664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786034391.479574:0:7664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034391.479575:0:7664:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1786034391.479576:0:7664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034391.479577:0:7664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034391.479579:0:7664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786034391.479580:0:7664:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1786034391.479581:0:7664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034391.479583:0:7664:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1786034391.479602:0:7664:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96457642c000 from lustre-OST0001 10000000:01000000:2.0:1786034391.479625:0:7664:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1786034391.479627:0:7664:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1786034391.479634:0:7664:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff964542f499c0 local copy 10000000:01000000:2.0:1786034391.479638:0:7664:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786034391.479671:0:7664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.479681:0:7664:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.479690:0:7664:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034391.479706:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636112384:0@lo:101: 00000100:00100000:2.0:1786034391.479740:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034391.479795:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c6ee900 going to sleep for 11 seconds 00000100:00100000:1.0:1786034391.480095:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636112384 00000100:00100000:1.0:1786034391.480101:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636112384 00000100:00100000:1.0:1786034391.480144:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786034391.480153:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:7664:x1872792636112384:12345-0@lo:101: 00010000:00010000:1.0:1786034391.480165:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034391.480178:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964541653e00/0x490975051af3faae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3faa7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.480212:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964541653e00/0x490975051af3faae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3faa7 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.480222:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964541653e00/0x490975051af3faae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3faa7 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.480230:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964541653e00, rc 0) 00000100:00100000:1.0:1786034391.480326:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:7664:x1872792636112384:12345-0@lo:101: Request processed in 174us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034391.480333:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1786034391.480404:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636112384:0@lo:101: 00010000:00010000:2.0:1786034391.480415:0:7664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x490975051af3faae expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.480423:0:7664:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x490975051af3faae expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034391.480517:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636112512:0@lo:501: 00000100:00100000:2.0:1786034391.480541:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034391.480564:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c6ee900 going to sleep for 11 seconds 00000100:00100000:1.0:1786034391.480611:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636112512 00000100:00100000:1.0:1786034391.480616:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636112512 00000100:00100000:1.0:1786034391.480642:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1786034391.480649:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:7664:x1872792636112512:12345-0@lo:501: 00000100:00100000:1.0:1786034391.480868:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:7664:x1872792636112512:12345-0@lo:501: Request processed in 218us (326us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786034391.480876:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1786034391.480907:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636112512:0@lo:501: 10000000:01000000:1.0:1786034391.480919:0:7664:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1786034391.480943:0:7664:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1786034391.480948:0:7664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x490975051af3faae expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.480956:0:7664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x490975051af3faae expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.480962:0:7664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x490975051af3faae expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.480982:0:7664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786034391.481170:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034391.481176:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x490975051af3faae expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.481195:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1e00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034391.481199:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x490975051af3faae expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.481207:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x490975051af3faae expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034391.481213:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x490975051af3faae expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034391.481218:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786034391.481298:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x490975051af3faae expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.481305:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034391.481332:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x490975051af3faae expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.481340:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff9645413f1e00/0x490975051af3faa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x490975051af3faae expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.481357:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034391.481359:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034391.481361:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034391.481368:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786034391.481378:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636112640:0@lo:103: 00000100:00100000:0.0:1786034391.481409:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034391.481442:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636112640 00000100:00100000:0.0:1786034391.481446:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636112640 00000100:00100000:0.0:1786034391.481484:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786034391.481490:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:3307:x1872792636112640:12345-0@lo:103: 00010000:00010000:0.0:1786034391.481498:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034391.481510:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964541653e00/0x490975051af3faae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3faa7 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.481521:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034391.481550:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:3307:x1872792636112640:12345-0@lo:103: Request processed in 60us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034391.481556:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786034391.481585:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636112640:0@lo:103: 10000000:01000000:1.0:1786034391.482227:0:7664:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96457642c000 10000000:01000000:1.0:1786034391.483086:0:7664:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1786034391.483094:0:7664:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1786034391.483098:0:7664:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786034391.483103:0:7664:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1786034391.483106:0:7664:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1786034391.483132:0:7664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.483141:0:7664:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.483150:0:7664:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034391.483165:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636112768:0@lo:101: 00000100:00100000:1.0:1786034391.483204:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034391.483354:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636112768 00000100:00100000:3.0:1786034391.483362:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636112768 00000100:00100000:3.0:1786034391.483394:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1786034391.483402:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+11:7664:x1872792636112768:12345-0@lo:101: 00010000:00010000:3.0:1786034391.483414:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034391.483426:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964562313400/0x490975051af3fabc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fab5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.483444:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964562313400/0x490975051af3fabc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fab5 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.483454:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964562313400/0x490975051af3fabc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fab5 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.483461:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562313400, rc 0) 00000100:00100000:3.0:1786034391.483491:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:7664:x1872792636112768:12345-0@lo:101: Request processed in 90us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034391.483497:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1786034391.483552:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594eb300 going to sleep for 11 seconds 00000100:00100000:1.0:1786034391.483567:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636112768:0@lo:101: 00010000:00010000:1.0:1786034391.483577:0:7664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fabc expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.483585:0:7664:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fabc expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034391.483658:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636112896:0@lo:501: 00000100:00100000:1.0:1786034391.483695:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034391.483817:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594eb300 going to sleep for 11 seconds 00000100:00100000:2.0:1786034391.490371:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636112896 00000100:00100000:2.0:1786034391.490384:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636112896 00000100:00100000:2.0:1786034391.490439:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1786034391.490448:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:7664:x1872792636112896:12345-0@lo:501: 00000100:00100000:2.0:1786034391.490735:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:7664:x1872792636112896:12345-0@lo:501: Request processed in 287us (7038us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034391.490743:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1786034391.490795:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636112896:0@lo:501: 00000100:00100000:2.0:1786034391.490862:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113024:0@lo:503: 00000100:00100000:2.0:1786034391.490905:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034391.490933:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c6ee240 going to sleep for 11 seconds 00000100:00100000:2.0:1786034391.490947:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636113024 00000100:00100000:2.0:1786034391.490951:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636113024 00000100:00100000:2.0:1786034391.490967:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1786034391.490973:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:7664:x1872792636113024:12345-0@lo:503: 00000100:00100000:2.0:1786034391.493147:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:7664:x1872792636113024:12345-0@lo:503: Request processed in 2167us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034391.493158:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1786034391.498790:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113024:0@lo:503: 00000040:00080000:1.0:1786034391.499684:0:7664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786034391.499757:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113152:0@lo:502: 00000100:00100000:1.0:1786034391.499849:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034391.499889:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594eb600 going to sleep for 11 seconds 00000100:00100000:3.0:1786034391.500028:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636113152 00000100:00100000:3.0:1786034391.500035:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636113152 00000100:00100000:3.0:1786034391.500073:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1786034391.500082:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:7664:x1872792636113152:12345-0@lo:502: 00000100:00100000:3.0:1786034391.500273:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:7664:x1872792636113152:12345-0@lo:502: Request processed in 191us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034391.500288:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786034391.500737:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113152:0@lo:502: 00000040:00080000:1.0:1786034391.501990:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1786034391.502116:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1786034391.502153:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1786034391.502199:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1786034391.505552:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1786034391.505651:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1786034391.505766:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113280:0@lo:502: 00000100:00100000:1.0:1786034391.506143:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034391.506227:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594eb600 going to sleep for 11 seconds 00000100:00100000:0.0:1786034391.509646:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636113280 00000100:00100000:0.0:1786034391.509716:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636113280 00000100:00100000:0.0:1786034391.509820:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1786034391.509854:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:7664:x1872792636113280:12345-0@lo:502: 00000100:00100000:0.0:1786034391.510105:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:7664:x1872792636113280:12345-0@lo:502: Request processed in 254us (3961us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034391.510113:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786034391.510199:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113280:0@lo:502: 00000040:00080000:1.0:1786034391.510367:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1786034391.510382:0:7664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1786034391.514010:0:7673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786034391.514021:0:7673:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1786034391.514028:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034391.514030:0:7673:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1786034391.514035:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786034391.514050:0:7673:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff964542f48000) 00000020:00000080:1.0:1786034391.514073:0:7673:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1786034391.514079:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1786034391.514159:0:7673:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96457642c000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1786034391.514167:0:7673:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1786034391.514174:0:7673:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x490975051af3faca 00010000:00010000:1.0:1786034391.522280:0:7673:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1786034391.522553:0:7673:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1786034391.528306:0:7673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1786034391.528574:0:7673:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1786034391.534584:0:7673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1786034391.535751:0:7673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1786034391.540336:0:7673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1786034391.540346:0:7673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786034391.540352:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034391.540354:0:7673:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1786034391.540358:0:7673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786034391.540361:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034391.540363:0:7673:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786034391.540365:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786034391.540367:0:7673:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1786034391.540414:0:7673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786034391.540417:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034391.540418:0:7673:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1786034391.540420:0:7673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1786034391.540733:0:7664:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1786034391.540758:0:7664:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1786034391.540783:0:7664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fabc expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.540794:0:7664:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fabc expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034391.540802:0:7664:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96457642c000 from 1 10000000:01000000:1.0:1786034391.540804:0:7664:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786034391.540855:0:7664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.540863:0:7664:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.540873:0:7664:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034391.540906:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113408:0@lo:101: 00000100:00100000:1.0:1786034391.540968:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034391.541010:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594eb300 going to sleep for 11 seconds 00000100:00100000:2.0:1786034391.541250:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636113408 00000100:00100000:2.0:1786034391.541257:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636113408 00000100:00100000:2.0:1786034391.541304:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1786034391.541312:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:7664:x1872792636113408:12345-0@lo:101: 00010000:00010000:2.0:1786034391.541324:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034391.541335:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9645413f0200/0x490975051af3fad8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fad1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.541354:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f0200/0x490975051af3fad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fad1 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.541363:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9645413f0200/0x490975051af3fad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fad1 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.541370:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0200, rc 0) 00000100:00100000:2.0:1786034391.541413:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:7664:x1872792636113408:12345-0@lo:101: Request processed in 101us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034391.541418:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1786034391.541761:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113408:0@lo:101: 00010000:00010000:0.0:1786034391.541774:0:7664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fad8 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.541782:0:7664:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fad8 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034391.541911:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113536:0@lo:501: 00000100:00100000:0.0:1786034391.541941:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034391.541973:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645593f5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786034391.542030:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636113536 00000100:00100000:2.0:1786034391.542034:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636113536 00000100:00100000:0.0:1786034391.542115:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1786034391.542124:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:7664:x1872792636113536:12345-0@lo:501: 00000100:00100000:0.0:1786034391.542340:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:7664:x1872792636113536:12345-0@lo:501: Request processed in 217us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034391.542347:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1786034391.542378:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113536:0@lo:501: 00000100:00100000:0.0:1786034391.542406:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113664:0@lo:503: 00000100:00100000:0.0:1786034391.542446:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034391.542467:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645593f5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786034391.542479:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636113664 00000100:00100000:0.0:1786034391.542483:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636113664 00000100:00100000:0.0:1786034391.542501:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1786034391.542507:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:7664:x1872792636113664:12345-0@lo:503: 00000100:00100000:0.0:1786034391.542977:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:7664:x1872792636113664:12345-0@lo:503: Request processed in 469us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034391.542984:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1786034391.543031:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113664:0@lo:503: 00000040:00080000:0.0:1786034391.543446:0:7664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786034391.543509:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113792:0@lo:502: 00000100:00100000:0.0:1786034391.543541:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034391.543567:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645593f5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786034391.543736:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636113792 00000100:00100000:1.0:1786034391.543741:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636113792 00000100:00100000:1.0:1786034391.543766:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1786034391.543773:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:7664:x1872792636113792:12345-0@lo:502: 00000100:00100000:1.0:1786034391.544859:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:7664:x1872792636113792:12345-0@lo:502: Request processed in 1085us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034391.544867:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1786034391.544885:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113792:0@lo:502: 00000040:00080000:2.0:1786034391.545301:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1786034391.545345:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1786034391.545369:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113920:0@lo:502: 00000100:00100000:2.0:1786034391.545402:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034391.545433:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c6ee900 going to sleep for 11 seconds 00000100:00100000:1.0:1786034391.545772:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636113920 00000100:00100000:1.0:1786034391.545778:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636113920 00000100:00100000:1.0:1786034391.545814:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1786034391.545839:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:7664:x1872792636113920:12345-0@lo:502: 00000100:00100000:1.0:1786034391.546045:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:7664:x1872792636113920:12345-0@lo:502: Request processed in 223us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034391.546052:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1786034391.546154:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636113920:0@lo:502: 00000040:00080000:2.0:1786034391.546301:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1786034391.546309:0:7664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1786034391.552250:0:7677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786034391.552264:0:7677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034391.552266:0:7677:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1786034391.552274:0:7677:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96457642c000 00000020:00000080:2.0:1786034391.552276:0:7677:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786034391.552296:0:7677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786034391.552298:0:7677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034391.552300:0:7677:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1786034391.552302:0:7677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1786034391.552911:0:7664:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1786034391.553311:0:7664:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786034391.553335:0:7664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fad8 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.553347:0:7664:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fad8 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034391.553385:0:7664:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1786034391.553388:0:7664:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96457642c000 10000000:01000000:3.0:1786034391.553391:0:7664:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96457642c000 10000000:01000000:3.0:1786034391.553395:0:7664:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786034391.553399:0:7664:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96457642c000 from 1 10000000:01000000:3.0:1786034391.553402:0:7664:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786034391.553434:0:7664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.553441:0:7664:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034391.553451:0:7664:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034391.553473:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636114048:0@lo:101: 00000100:00100000:3.0:1786034391.553530:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034391.553574:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560a953c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034391.553624:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636114048 00000100:00100000:2.0:1786034391.553630:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636114048 00000100:00100000:2.0:1786034391.555991:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1786034391.556017:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:7664:x1872792636114048:12345-0@lo:101: 00010000:00010000:2.0:1786034391.556032:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034391.556047:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9645413f0000/0x490975051af3fae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fadf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.556082:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f0000/0x490975051af3fae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fadf expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.556109:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9645413f0000/0x490975051af3fae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fadf expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.556118:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0000, rc 0) 00000100:00100000:2.0:1786034391.556190:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:7664:x1872792636114048:12345-0@lo:101: Request processed in 188us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034391.556197:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1786034391.556286:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636114048:0@lo:101: 00010000:00010000:0.0:1786034391.556300:0:7664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fae6 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.556317:0:7664:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fae6 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034391.556412:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636114176:0@lo:501: 00000100:00100000:0.0:1786034391.556444:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034391.559781:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645593f5180 going to sleep for 11 seconds 00000100:00100000:3.0:1786034391.560571:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636114176 00000100:00100000:3.0:1786034391.560580:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636114176 00000100:00100000:3.0:1786034391.560630:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1786034391.560636:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:7664:x1872792636114176:12345-0@lo:501: 00000100:00100000:3.0:1786034391.560905:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:7664:x1872792636114176:12345-0@lo:501: Request processed in 268us (4459us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034391.560913:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1786034391.563232:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636114176:0@lo:501: 00000100:00100000:0.0:1786034391.563296:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636114304:0@lo:503: 00000100:00100000:0.0:1786034391.563363:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034391.563397:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645593f5180 going to sleep for 11 seconds 00000100:00100000:1.0:1786034391.563503:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636114304 00000100:00100000:1.0:1786034391.563509:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636114304 00000100:00100000:1.0:1786034391.563548:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1786034391.563555:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:7664:x1872792636114304:12345-0@lo:503: 00000100:00100000:1.0:1786034391.563722:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:7664:x1872792636114304:12345-0@lo:503: Request processed in 166us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034391.563730:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1786034391.563799:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636114304:0@lo:503: 00000040:00080000:0.0:1786034391.564128:0:7664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786034391.564191:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636114432:0@lo:502: 00000100:00100000:0.0:1786034391.564221:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034391.564237:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645593f5180 going to sleep for 11 seconds 00000100:00100000:1.0:1786034391.564441:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636114432 00000100:00100000:1.0:1786034391.564445:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636114432 00000100:00100000:1.0:1786034391.564466:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1786034391.564471:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:7664:x1872792636114432:12345-0@lo:502: 00000100:00100000:1.0:1786034391.564612:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:7664:x1872792636114432:12345-0@lo:502: Request processed in 140us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034391.564618:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1786034391.564691:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636114432:0@lo:502: 00000040:00080000:0.0:1786034391.565201:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1786034391.565246:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1786034391.565451:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1786034391.565510:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1786034391.565544:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1786034391.565591:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1786034391.565621:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1786034391.565650:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1786034391.565707:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1786034391.565746:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1786034391.566607:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1786034391.566661:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1786034391.566700:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1786034391.566737:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1786034391.566782:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1786034391.566812:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1786034391.571237:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1786034391.572044:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1786034391.572247:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1786034391.572349:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1786034391.572392:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1786034391.572420:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1786034391.572445:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1786034391.572727:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1786034391.572786:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1786034391.572816:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1786034391.573054:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1786034391.573364:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1786034391.573397:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1786034391.573438:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1786034391.573469:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1786034391.573499:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1786034391.573527:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1786034391.573584:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1786034391.573625:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1786034391.573690:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1786034391.573727:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1786034391.573772:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636114560:0@lo:502: 00000100:00100000:0.0:1786034391.574417:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034391.574514:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645593f5180 going to sleep for 11 seconds 00000100:00100000:1.0:1786034391.580182:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636114560 00000100:00100000:1.0:1786034391.580196:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636114560 00000100:00100000:1.0:1786034391.580302:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1786034391.580324:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:7664:x1872792636114560:12345-0@lo:502: 00000100:00100000:1.0:1786034391.580598:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:7664:x1872792636114560:12345-0@lo:502: Request processed in 275us (6181us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034391.580606:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1786034391.580687:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636114560:0@lo:502: 00000040:00080000:0.0:1786034391.580798:0:7664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1786034391.580812:0:7664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1786034391.581594:0:7678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1786034391.581609:0:7678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff96457e3399c0) 00000020:00000080:0.0:1786034391.581628:0:7678:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1786034391.581785:0:7678:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96457642c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1786034391.581789:0:7678:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96457642c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1786034391.581792:0:7678:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96457642c000 3 00010000:00080000:0.0:1786034391.581817:0:7678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96444507b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.156@tcp at head 00010000:00010000:0.0:1786034391.588453:0:7678:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1786034391.588538:0:7678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1786034391.588570:0:7678:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1786034391.588592:0:7678:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x490975051af3faf4 00000100:00080000:0.0:1786034391.588602:0:7678:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786034391.588607:0:7678:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96444507b800 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:0.0:1786034391.588637:0:7678:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96455a5b2a00 x1872792636114688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786034391.588676:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1872792636114688:0@lo:38: 00000100:00100000:0.0:1786034391.588738:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034391.588792:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636114688 00000100:00100000:0.0:1786034391.588797:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636114688 00000100:00100000:0.0:1786034391.588839:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786034391.588845:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3306:x1872792636114688:12345-0@lo:38: 00010000:00080000:0.0:1786034391.588875:0:6743:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:0.0:1786034391.588901:0:6743:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x490975051af3fafb 00000004:00100000:0.0:1786034391.588914:0:6743:0:(mdt_handler.c:7332:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786034391.588954:0:6743:0:(import.c:65:import_set_state_nolock()) ffff9644469ab000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786034391.589022:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1872792636114688:12345-0@lo:38: Request processed in 175us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034391.589029:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1786034391.589094:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96455a5b2a00 x1872792636114688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786034401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034391.589104:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786034391.589111:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1786034391.589117:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1786034391.589121:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1786034391.589123:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96444507b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786034391.589128:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1872792636114688:0@lo:38: 00000100:00080000:0.0:1786034391.589158:0:7678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1786034391.589221:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636114816:0@lo:400: 00000100:00100000:0.0:1786034391.589246:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034391.589266:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034391.589271:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636114944:0@lo:400: 00000100:00100000:0.0:1786034391.589291:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034391.589338:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636115072:0@lo:400: 00000100:00100000:0.0:1786034391.589370:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034391.589418:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636114816 00000100:00100000:0.0:1786034391.589421:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636114816 00000100:00100000:0.0:1786034391.589441:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636114944 00000100:00100000:0.0:1786034391.589443:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636114944 00000100:00100000:0.0:1786034391.589463:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786034391.589468:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636114816:12345-0@lo:400: 00000100:00100000:0.0:1786034391.589497:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636114816:12345-0@lo:400: Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034391.589508:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786034391.589533:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786034391.589538:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636114944:12345-0@lo:400: 00000100:00100000:0.0:1786034391.589561:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636114944:12345-0@lo:400: Request processed in 23us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034391.589565:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786034391.589595:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636115072 00000100:00100000:0.0:1786034391.589598:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636115072 00000100:00100000:0.0:1786034391.589635:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786034391.589640:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636115072:12345-0@lo:400: 00000100:00100000:0.0:1786034391.589667:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636115072:12345-0@lo:400: Request processed in 27us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034391.589672:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1786034391.589685:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786034391.589689:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786034391.589708:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96455a5b2300 x1872792636115072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034391.589717:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636115072:0@lo:400: 00010000:00080000:0.0:1786034391.589739:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96455a5b1f80 x1872792636114944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034391.589746:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636114944:0@lo:400: 00010000:00080000:0.0:1786034391.589753:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96455a5b2a00 x1872792636114816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034391.589759:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636114816:0@lo:400: 00000040:00080000:0.0:1786034391.594365:0:7678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1786034391.594561:0:7664:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1786034391.594583:0:7664:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786034391.594605:0:7664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fae6 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.594616:0:7664:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fae6 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786034391.594658:0:7664:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786034391.594660:0:7664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786034391.594661:0:7664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786034391.594662:0:7664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786034391.594664:0:7664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786034391.594665:0:7664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786034391.594666:0:7664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786034391.594668:0:7664:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786034391.594669:0:7664:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786034391.594671:0:7664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786034391.594672:0:7664:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786034391.594676:0:7664:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1786034391.594678:0:7664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786034391.594680:0:7664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786034391.594681:0:7664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786034391.594681:0:7664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786034391.594682:0:7664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786034391.594683:0:7664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786034391.594684:0:7664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786034391.594686:0:7664:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786034391.594686:0:7664:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786034391.594688:0:7664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786034391.594689:0:7664:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786034391.594719:0:7664:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1786034391.594736:0:7664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636115200:0@lo:253: 00000100:00100000:1.0:1786034391.594792:0:7664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034391.594847:0:7664:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454ad06180 going to sleep for 11 seconds 00000100:00100000:3.0:1786034391.596208:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636115200 00000100:00100000:3.0:1786034391.596218:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636115200 00000100:00100000:3.0:1786034391.596261:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1786034391.596447:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:7664:x1872792636115200:12345-0@lo:253: 20000000:01000000:3.0:1786034391.596473:0:5855:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1786034391.596485:0:5855:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1786034391.598175:0:7680:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e61500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7680:1872792636115328:0@lo:901: 00000100:00100000:3.0:1786034391.598233:0:7680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034391.598257:0:7680:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560a95000 going to sleep for 11 seconds 00000100:00100000:0.0:1786034391.598710:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636115328 00000100:00100000:0.0:1786034391.598717:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636115328 00000100:00100000:0.0:1786034391.598760:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786034391.598768:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7680:x1872792636115328:12345-0@lo:901: 00000100:00100000:0.0:1786034391.599609:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7680:x1872792636115328:12345-0@lo:901: Request processed in 840us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034391.599618:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1786034391.599639:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1786034391.599723:0:7680:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964549e61500 x1872792636115328/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1786034407 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034391.599736:0:7680:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e61500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7680:1872792636115328:0@lo:901: 00010000:00010000:3.0:1786034391.665894:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1786034391.670644:0:5855:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786034391.670664:0:5855:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1786034391.671593:0:5877:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1786034391.671599:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1786034391.671620:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.671638:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964562312a00/0x490975051af3fa53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fa4c expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.671647:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.671683:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964562312a00/0x490975051af3fa53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fa4c expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034391.671695:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964562312a00/0x490975051af3fa53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fa4c expref: 14 pid: 5856 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034391.671708:0:5877:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1872792636115456:0@lo:104: 00000100:00100000:2.0:1786034391.671766:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034391.671811:0:5877:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455a5ca480 going to sleep for 11 seconds 00000100:00100000:1.0:1786034391.673363:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636115456 00000100:00100000:1.0:1786034391.673372:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636115456 00000100:00100000:1.0:1786034391.673421:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786034391.673430:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5877:x1872792636115456:12345-0@lo:104: 00010000:00010000:1.0:1786034391.673443:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fa53 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673512:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786034391.673517:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:5877:x1872792636115456:12345-0@lo:104: Request processed in 89us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034391.673524:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1786034391.673544:0:7670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034391.673548:0:7670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fa53 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673555:0:7670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0400 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:1.0:1786034391.673559:0:7670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fa53 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673566:0:7670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fa53 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786034391.673571:0:7670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fa53 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034391.673576:0:7670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1786034391.673613:0:7670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa53 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673619:0:7670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786034391.673632:0:7670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa53 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673638:0:7670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff9645413f0400/0x490975051af3fa4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa53 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673654:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034391.673656:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034391.673658:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034391.673678:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636115584:0@lo:103: 00000100:00100000:1.0:1786034391.673708:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034391.673746:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636115584 00000100:00100000:1.0:1786034391.673750:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636115584 00010000:00010000:1.0:1786034391.673764:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964562312a00/0x490975051af3fa53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fa4c expref: 15 pid: 5856 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034391.673784:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786034391.673790:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a061450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:3308:x1872792636115584:12345-0@lo:103: 00010000:00010000:1.0:1786034391.673798:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034391.673803:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964562312a00/0x490975051af3fa53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fa4c expref: 15 pid: 5856 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673812:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964562312a00/0x490975051af3fa53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fa4c expref: 15 pid: 5856 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673851:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673866:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786034391.673878:0:5848:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002280124s 00010000:00010000:1.0:1786034391.673882:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673889:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673895:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673901:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673906:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0e00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034391.673910:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673916:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.673925:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034391.674235:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034391.674263:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a061450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:3308:x1872792636115584:12345-0@lo:103: Request processed in 474us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034391.674269:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786034391.674339:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636115584:0@lo:103: 00010000:00010000:0.0:1786034391.674479:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964562312a00/0x490975051af3fa53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fa4c expref: 14 pid: 5856 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034391.674488:0:5877:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1872792636115456:0@lo:104: 00010000:00010000:0.0:1786034391.674500:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.674508:0:5877:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.674513:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034391.674517:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f0e00/0x490975051af3fb02 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034391.710103:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:7664:x1872792636115200:12345-0@lo:253: Request processed in 113654us (115304us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034391.710116:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1786034391.710276:0:7664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:117a9d0c-602c-47bd-a536-8de3b3d11e1e:7664:1872792636115200:0@lo:253: 10000000:01000000:1.0:1786034391.710292:0:7664:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1786034391.710296:0:7664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786034391.710297:0:7664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786034391.710299:0:7664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786034391.710299:0:7664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786034391.710300:0:7664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786034391.710302:0:7664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786034391.710303:0:7664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786034391.710304:0:7664:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786034391.710305:0:7664:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786034391.710307:0:7664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786034391.710308:0:7664:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786034391.710321:0:7664:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1786034391.715700:0:7664:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1786034391.716325:0:7664:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1786034391.716489:0:7664:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1786034391.716632:0:7664:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1786034391.716813:0:7664:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1786034391.718292:0:7664:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1786034391.729348:0:7664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1786034392.132174:0:7664:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1786034392.132182:0:7664:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1786034392.132261:0:7664:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1786034392.132322:0:7664:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1786034392.132339:0:7664:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1786034392.132368:0:7664:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1786034392.692777:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034393.647951:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786034393.647975:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636115712:0@lo:13: 00000100:00100000:0.0:1786034393.648102:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034393.649351:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636115712 00000100:00100000:3.0:1786034393.649359:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636115712 00000100:00100000:3.0:1786034393.649423:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786034393.649438:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636115712:12345-0@lo:13: 00002000:00000024:3.0:1786034393.649468:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034393.649520:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636115712:12345-0@lo:13: Request processed in 83us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034393.649527:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1786034393.649771:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964549e61500 x1872792636115712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034393.649797:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636115712:0@lo:13: 00000100:00080000:0.0:1786034393.649944:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786034393.719130:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034394.736984:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034395.760723:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034396.720596:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636116224:0@lo:400: 00000100:00100000:3.0:1786034396.720665:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034396.720732:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786034396.720739:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636115840:0@lo:400: 00000100:00100000:3.0:1786034396.720770:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034396.720789:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636116352:0@lo:400: 00000100:00100000:3.0:1786034396.720814:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034396.720862:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636116352 00000100:00100000:3.0:1786034396.720869:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636116352 00000100:00100000:3.0:1786034396.720914:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786034396.720922:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636116352:12345-0@lo:400: 00000100:00100000:3.0:1786034396.720993:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636116352:12345-0@lo:400: Request processed in 71us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034396.721000:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1786034396.721036:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb5180 x1872792636116352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034396.721050:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636116352:0@lo:400: 00000100:00080000:0.0:1786034396.721219:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034396.721274:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636115968:0@lo:400: 00000100:00100000:1.0:1786034396.721303:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034396.721328:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786034396.721334:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636116096:0@lo:400: 00000100:00100000:1.0:1786034396.721352:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034396.721386:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636115840 00000100:00100000:1.0:1786034396.721389:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636115840 00000100:00100000:1.0:1786034396.721415:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1786034396.721422:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:3309:x1872792636115840:12345-0@lo:400: 00000100:00100000:1.0:1786034396.721466:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:3309:x1872792636115840:12345-0@lo:400: Request processed in 44us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034396.721473:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1786034396.721713:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636115968 00000100:00100000:0.0:1786034396.721718:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636115968 00000100:00100000:0.0:1786034396.721749:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636116096 00000100:00100000:0.0:1786034396.721753:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636116096 00000100:00100000:0.0:1786034396.721774:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786034396.721780:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636115968:12345-0@lo:400: 00000100:00100000:0.0:1786034396.721841:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636115968:12345-0@lo:400: Request processed in 42us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034396.721847:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786034396.721860:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786034396.721866:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636116096:12345-0@lo:400: 00000100:00100000:0.0:1786034396.721893:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636116096:12345-0@lo:400: Request processed in 27us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034396.721899:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1786034396.721914:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786034396.721945:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb7b80 x1872792636116096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034396.721956:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636116096:0@lo:400: 00010000:00080000:0.0:1786034396.721975:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb4000 x1872792636115968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034396.721984:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636115968:0@lo:400: 00000100:00100000:2.0:1786034396.722136:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636116224 00000100:00100000:2.0:1786034396.722142:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636116224 00000100:00100000:2.0:1786034396.722182:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786034396.722189:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636116224:12345-0@lo:400: 00000100:00100000:2.0:1786034396.722223:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636116224:12345-0@lo:400: Request processed in 35us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034396.722229:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786034396.724114:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636115840:0@lo:400: 00010000:00080000:3.0:1786034396.724131:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb7800 x1872792636116224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034396.724158:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636116224:0@lo:400: 00000100:00080000:0.0:1786034396.726033:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786034396.786737:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034397.815908:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034398.768332:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636116480:0@lo:13: 00000100:00100000:0.0:1786034398.769112:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034398.770017:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636116480 00000100:00100000:1.0:1786034398.770028:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636116480 00000100:00100000:1.0:1786034398.770081:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786034398.770091:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636116480:12345-0@lo:13: 00002000:00000024:1.0:1786034398.770121:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034398.770227:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636116480:12345-0@lo:13: Request processed in 86us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034398.770235:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1786034398.770278:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96455a5b1f80 x1872792636116480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034398.770295:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636116480:0@lo:13: 00000100:00080000:0.0:1786034398.773852:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786034398.843165:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034399.856280:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786034400.630490:0:8022:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1786034400.816282:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786034400.816290:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff964548917000 from 30 10000000:01000000:1.0:1786034400.816295:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786034400.816334:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.816345:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.816356:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034400.816377:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636116608:0@lo:101: 00000100:00100000:1.0:1786034400.816443:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.816490:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964559efb480 going to sleep for 11 seconds 00000100:00100000:0.0:1786034400.816606:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636116608 00000100:00100000:0.0:1786034400.816614:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636116608 00000100:00100000:0.0:1786034400.816666:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1786034400.816674:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:5858:x1872792636116608:12345-0@lo:101: 00010000:00010000:0.0:1786034400.816686:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034400.816697:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964582166800/0x490975051af3fb10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fb09 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.816718:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964582166800/0x490975051af3fb10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fb09 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.816727:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964582166800/0x490975051af3fb10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fb09 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.816737:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964582166800, rc 0) 00000100:00100000:0.0:1786034400.816935:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636116608:12345-0@lo:101: Request processed in 252us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034400.816943:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1786034400.817103:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636116608:0@lo:101: 00010000:00010000:2.0:1786034400.817118:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb10 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034400.817282:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fb10 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034400.817330:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636116736:0@lo:501: 00000100:00100000:2.0:1786034400.817355:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034400.817409:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645482699c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034400.817515:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636116736 00000100:00100000:1.0:1786034400.817520:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636116736 00000100:00100000:1.0:1786034400.817580:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1786034400.817588:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636116736:12345-0@lo:501: 00000100:00100000:1.0:1786034400.818099:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636116736:12345-0@lo:501: Request processed in 512us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034400.818106:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1786034400.818310:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636116736:0@lo:501: 00000100:00100000:3.0:1786034400.818338:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636116864:0@lo:503: 00000100:00100000:3.0:1786034400.818371:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034400.818398:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca840 going to sleep for 11 seconds 00000100:00100000:0.0:1786034400.818480:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636116864 00000100:00100000:0.0:1786034400.818484:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636116864 00000100:00100000:0.0:1786034400.818512:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1786034400.818518:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636116864:12345-0@lo:503: 00000100:00100000:0.0:1786034400.819287:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636116864:12345-0@lo:503: Request processed in 444us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034400.819297:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1786034400.819417:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636116864:0@lo:503: 00000100:00100000:3.0:1786034400.819772:0:8037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8037:1872792636116992:0@lo:502: 00000100:00100000:3.0:1786034400.819950:0:8037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034400.820010:0:8037:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034400.820051:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636116992 00000100:00100000:1.0:1786034400.820056:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636116992 00000100:00100000:1.0:1786034400.820085:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1786034400.820091:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:8037:x1872792636116992:12345-0@lo:502: 00000100:00100000:1.0:1786034400.820468:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:8037:x1872792636116992:12345-0@lo:502: Request processed in 370us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034400.820476:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1786034400.820535:0:8037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8037:1872792636116992:0@lo:502: 00000100:00100000:3.0:1786034400.820570:0:8037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8037:1872792636117120:0@lo:502: 00000100:00100000:3.0:1786034400.820598:0:8037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034400.820625:0:8037:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034400.820764:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636117120 00000100:00100000:1.0:1786034400.820768:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636117120 00000100:00100000:1.0:1786034400.820795:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1786034400.820801:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:8037:x1872792636117120:12345-0@lo:502: 00000100:00100000:1.0:1786034400.820999:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:8037:x1872792636117120:12345-0@lo:502: Request processed in 197us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034400.821005:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1786034400.821071:0:8037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8037:1872792636117120:0@lo:502: 00000040:00080000:3.0:1786034400.821088:0:8037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1786034400.821393:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1786034400.821410:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786034400.821418:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb10 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.821439:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb10 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034400.821448:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1786034400.821451:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1786034400.821453:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1786034400.821483:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.821491:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.821500:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034400.821511:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636117248:0@lo:101: 00000100:00100000:1.0:1786034400.821535:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.821561:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964559b5bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034400.821594:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636117248 00000100:00100000:0.0:1786034400.821603:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636117248 00000100:00100000:0.0:1786034400.821637:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1786034400.821643:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636117248:12345-0@lo:101: 00010000:00010000:0.0:1786034400.821651:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034400.821660:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964582167600/0x490975051af3fb1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fb17 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.821677:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964582167600/0x490975051af3fb1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fb17 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.821686:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964582167600/0x490975051af3fb1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fb17 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.821695:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964582167600, rc 0) 00000100:00100000:0.0:1786034400.821728:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636117248:12345-0@lo:101: Request processed in 85us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034400.821734:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1786034400.821920:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636117248:0@lo:101: 00010000:00010000:1.0:1786034400.821940:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb1e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.821948:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fb1e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034400.821981:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636117376:0@lo:501: 00000100:00100000:1.0:1786034400.822004:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.822026:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964559b5bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034400.822070:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636117376 00000100:00100000:0.0:1786034400.822074:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636117376 00000100:00100000:0.0:1786034400.822100:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1786034400.822106:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636117376:12345-0@lo:501: 00000100:00100000:0.0:1786034400.822461:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636117376:12345-0@lo:501: Request processed in 354us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034400.822468:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1786034400.822595:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636117376:0@lo:501: 00000100:00100000:1.0:1786034400.822625:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636117504:0@lo:503: 00000100:00100000:1.0:1786034400.822655:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.822680:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964559b5bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034400.822753:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636117504 00000100:00100000:3.0:1786034400.822757:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636117504 00000100:00100000:3.0:1786034400.822857:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1786034400.822864:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636117504:12345-0@lo:503: 00000100:00100000:3.0:1786034400.823123:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636117504:12345-0@lo:503: Request processed in 258us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034400.823140:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1786034400.823405:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636117504:0@lo:503: 00000100:00100000:0.0:1786034400.824028:0:8038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8038:1872792636117632:0@lo:502: 00000100:00100000:0.0:1786034400.824063:0:8038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034400.824090:0:8038:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf780 going to sleep for 11 seconds 00000100:00100000:3.0:1786034400.824132:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636117632 00000100:00100000:3.0:1786034400.824141:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636117632 00000100:00100000:3.0:1786034400.824326:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1786034400.824333:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:8038:x1872792636117632:12345-0@lo:502: 00000100:00100000:3.0:1786034400.824498:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:8038:x1872792636117632:12345-0@lo:502: Request processed in 164us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034400.824504:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1786034400.824611:0:8038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8038:1872792636117632:0@lo:502: 00000020:01000000:0.0:1786034400.824692:0:8038:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786034400.824699:0:8038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034400.824701:0:8038:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786034400.824705:0:8038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786034400.824707:0:8038:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1786034400.824720:0:8038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8038:1872792636117760:0@lo:502: 00000100:00100000:0.0:1786034400.824748:0:8038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034400.824767:0:8038:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf780 going to sleep for 11 seconds 00000100:00100000:3.0:1786034400.824951:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636117760 00000100:00100000:3.0:1786034400.824955:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636117760 00000100:00100000:3.0:1786034400.824981:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1786034400.824987:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:8038:x1872792636117760:12345-0@lo:502: 00000100:00100000:3.0:1786034400.825099:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:8038:x1872792636117760:12345-0@lo:502: Request processed in 111us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034400.825105:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1786034400.825334:0:8038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8038:1872792636117760:0@lo:502: 00000020:01000000:0.0:1786034400.825350:0:8038:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034400.825354:0:8038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034400.825356:0:8038:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1786034400.825360:0:8038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1786034400.825476:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1786034400.825490:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1786034400.825497:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb1e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.825507:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb1e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034400.825516:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786034400.825518:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff964559843800 from 30 10000000:01000000:1.0:1786034400.825521:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786034400.825540:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.825548:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.825556:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034400.825567:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636117888:0@lo:101: 00000100:00100000:1.0:1786034400.825590:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.825609:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a0b6180 going to sleep for 11 seconds 00000100:00100000:3.0:1786034400.825753:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636117888 00000100:00100000:3.0:1786034400.825756:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636117888 00000100:00100000:3.0:1786034400.825887:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1786034400.825895:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636117888:12345-0@lo:101: 00010000:00010000:3.0:1786034400.825903:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034400.825912:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964562312600/0x490975051af3fb2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fb25 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034400.825940:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964562312600/0x490975051af3fb2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fb25 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034400.825950:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964562312600/0x490975051af3fb2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fb25 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034400.825957:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312600, rc 0) 00000100:00100000:3.0:1786034400.825988:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636117888:12345-0@lo:101: Request processed in 95us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034400.826001:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1786034400.826062:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636117888:0@lo:101: 00010000:00010000:0.0:1786034400.826074:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb2c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.826082:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fb2c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034400.826114:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636118016:0@lo:501: 00000100:00100000:0.0:1786034400.826154:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034400.826404:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf780 going to sleep for 11 seconds 00000100:00100000:1.0:1786034400.826429:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636118016 00000100:00100000:1.0:1786034400.826433:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636118016 00000100:00100000:1.0:1786034400.826452:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1786034400.826457:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636118016:12345-0@lo:501: 00000100:00100000:1.0:1786034400.826633:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636118016:12345-0@lo:501: Request processed in 175us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034400.826640:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1786034400.826735:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636118016:0@lo:501: 00000100:00100000:0.0:1786034400.826757:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636118144:0@lo:503: 00000100:00100000:0.0:1786034400.826797:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034400.826885:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf780 going to sleep for 11 seconds 00000100:00100000:2.0:1786034400.826957:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636118144 00000100:00100000:2.0:1786034400.826961:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636118144 00000100:00100000:3.0:1786034400.827368:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1786034400.827376:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636118144:12345-0@lo:503: 00000100:00100000:3.0:1786034400.827529:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636118144:12345-0@lo:503: Request processed in 153us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034400.827536:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1786034400.827598:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636118144:0@lo:503: 00000100:00100000:1.0:1786034400.828065:0:8039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8039:1872792636118272:0@lo:502: 00000100:00100000:1.0:1786034400.828096:0:8039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.828151:0:8039:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560a1d540 going to sleep for 11 seconds 00000100:00100000:3.0:1786034400.828330:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636118272 00000100:00100000:3.0:1786034400.828335:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636118272 00000100:00100000:3.0:1786034400.828390:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1786034400.828396:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:8039:x1872792636118272:12345-0@lo:502: 00000100:00100000:3.0:1786034400.828538:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:8039:x1872792636118272:12345-0@lo:502: Request processed in 142us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034400.828545:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1786034400.828603:0:8039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8039:1872792636118272:0@lo:502: 00000100:00100000:2.0:1786034400.828648:0:8039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8039:1872792636118400:0@lo:502: 00000100:00100000:2.0:1786034400.828682:0:8039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.829015:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636118400 00000100:00100000:1.0:1786034400.829020:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636118400 00000100:00100000:1.0:1786034400.829039:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1786034400.829044:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:8039:x1872792636118400:12345-0@lo:502: 00000100:00100000:1.0:1786034400.829317:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:8039:x1872792636118400:12345-0@lo:502: Request processed in 125us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034400.829325:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1786034400.829410:0:8039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645482699c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034400.829423:0:8039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8039:1872792636118400:0@lo:502: 00000040:00080000:0.0:1786034400.829440:0:8039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1786034400.829573:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1786034400.829588:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786034400.829595:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb2c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.829605:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb2c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034400.829614:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1786034400.829668:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff964559843800 from 5 10000000:01000000:1.0:1786034400.829671:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786034400.829698:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.829706:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.829715:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034400.829727:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636118528:0@lo:101: 00000100:00100000:1.0:1786034400.829751:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.829932:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560a1dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034400.829987:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636118528 00000100:00100000:0.0:1786034400.829992:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636118528 00000100:00100000:0.0:1786034400.830044:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1786034400.830051:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636118528:12345-0@lo:101: 00010000:00010000:0.0:1786034400.830060:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034400.830071:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964582167c00/0x490975051af3fb3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fb33 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.830089:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964582167c00/0x490975051af3fb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fb33 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.830098:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964582167c00/0x490975051af3fb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fb33 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.830106:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964582167c00, rc 0) 00000100:00100000:0.0:1786034400.830306:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636118528:12345-0@lo:101: Request processed in 254us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034400.830312:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1786034400.830365:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636118528:0@lo:101: 00010000:00010000:1.0:1786034400.830375:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.830384:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034400.830421:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636118656:0@lo:256: 00000100:00100000:1.0:1786034400.830447:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.830552:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560a1dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034400.830606:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636118656 00000100:00100000:3.0:1786034400.830609:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636118656 00000100:00100000:3.0:1786034400.830634:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1786034400.830640:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636118656:12345-0@lo:256: 20000000:01000000:3.0:1786034400.830652:0:5855:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1786034400.830665:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786034400.830668:0:5855:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1786034400.830739:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636118656:12345-0@lo:256: Request processed in 98us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034400.830746:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1786034400.830915:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636118656:0@lo:256: 10000000:01000000:1.0:1786034400.830960:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786034400.830965:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.830973:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034400.830984:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1786034400.830986:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1786034400.830988:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1786034400.831002:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.831009:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.831017:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034400.831028:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636118784:0@lo:101: 00000100:00100000:1.0:1786034400.831049:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.831073:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964549eb1600 going to sleep for 11 seconds 00000100:00100000:3.0:1786034400.831112:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636118784 00000100:00100000:3.0:1786034400.831116:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636118784 00000100:00100000:3.0:1786034400.831141:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1786034400.831152:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636118784:12345-0@lo:101: 00010000:00010000:3.0:1786034400.831163:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034400.831180:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964562312000/0x490975051af3fb48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fb41 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034400.831194:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964562312000/0x490975051af3fb48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fb41 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034400.831202:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964562312000/0x490975051af3fb48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fb41 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034400.831208:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312000, rc 0) 00000100:00100000:3.0:1786034400.831238:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636118784:12345-0@lo:101: Request processed in 86us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034400.831244:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1786034400.831405:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636118784:0@lo:101: 00010000:00010000:1.0:1786034400.831415:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb48 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034400.831423:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fb48 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034400.831457:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636118912:0@lo:501: 00000100:00100000:1.0:1786034400.831477:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.831495:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964549eb1600 going to sleep for 11 seconds 00000100:00100000:3.0:1786034400.831575:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636118912 00000100:00100000:3.0:1786034400.831579:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636118912 00000100:00100000:3.0:1786034400.831595:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1786034400.831600:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636118912:12345-0@lo:501: 00000100:00100000:3.0:1786034400.831942:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636118912:12345-0@lo:501: Request processed in 341us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034400.831949:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1786034400.832151:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636118912:0@lo:501: 00000100:00100000:1.0:1786034400.832320:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636119040:0@lo:503: 00000100:00100000:1.0:1786034400.832354:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.832379:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964549eb1600 going to sleep for 11 seconds 00000100:00100000:0.0:1786034400.832418:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636119040 00000100:00100000:0.0:1786034400.832422:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636119040 00000100:00100000:0.0:1786034400.832449:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1786034400.832454:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636119040:12345-0@lo:503: 00000100:00100000:0.0:1786034400.832876:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636119040:12345-0@lo:503: Request processed in 420us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034400.832890:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786034400.832959:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636119040:0@lo:503: 00000100:00100000:1.0:1786034400.833421:0:8040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8040:1872792636119168:0@lo:502: 00000100:00100000:1.0:1786034400.833451:0:8040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.833475:0:8040:0:(client.c:2702:ptlrpc_set_wait()) set ffff964549eb1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786034400.833517:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636119168 00000100:00100000:2.0:1786034400.833521:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636119168 00000100:00100000:2.0:1786034400.833548:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1786034400.833555:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:8040:x1872792636119168:12345-0@lo:502: 00000100:00100000:2.0:1786034400.833879:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:8040:x1872792636119168:12345-0@lo:502: Request processed in 324us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034400.833886:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1786034400.834004:0:8040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8040:1872792636119168:0@lo:502: 00000020:01000000:0.0:1786034400.834028:0:8040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1786034400.834034:0:8040:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1786034400.834040:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034400.834042:0:8040:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1786034400.834046:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1786034400.834050:0:8040:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.156@tcp to nid 0x20000c0a8cb9c (192.168.203.156@tcp) 00000020:01000000:0.0:1786034400.834069:0:8040:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1786034400.834071:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786034400.834091:0:8040:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff964548a0b380) 00000020:00000080:0.0:1786034400.834109:0:8040:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1786034400.834114:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1786034400.834367:0:8040:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1786034400.834372:0:8040:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1786034400.834378:0:8040:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x490975051af3fb56 00010000:00080000:0.0:1786034400.834404:0:8040:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9644469ab800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.156@tcp at head 00010000:00010000:0.0:1786034400.834597:0:8040:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1786034400.835004:0:8040:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1786034400.835015:0:8040:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1786034400.836562:0:8040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786034400.837006:0:8040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786034400.837058:0:8040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1786034400.837122:0:8040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1786034400.837698:0:8041:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786034400.837703:0:8041:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1786034400.838493:0:8040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786034400.838503:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1786034400.838529:0:8040:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1786034400.838547:0:8040:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x490975051af3fb5d 00000100:00080000:0.0:1786034400.838556:0:8040:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786034400.838567:0:8040:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9644469ab800 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:0.0:1786034400.838596:0:8040:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96455a5b2680 x1872792636119296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786034400.838701:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636119296:0@lo:8: 00000100:00100000:2.0:1786034400.838756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786034400.838851:0:8040:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1786034400.838938:0:8040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034400.838943:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034400.838945:0:8040:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1786034400.838947:0:8040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786034400.838951:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034400.838952:0:8040:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786034400.838954:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786034400.838956:0:8040:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1786034400.838976:0:8040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8040:1872792636119424:0@lo:502: 00000100:00100000:1.0:1786034400.839102:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636119552:0@lo:400: 00000100:00100000:3.0:1786034400.839163:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636119296 00000100:00100000:3.0:1786034400.839177:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636119296 00000100:00100000:3.0:1786034400.839204:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786034400.839211:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1872792636119296:12345-0@lo:8: 00010000:00080000:3.0:1786034400.839231:0:6720:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:3.0:1786034400.839268:0:6720:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x490975051af3fb64 00000100:00100000:0.0:1786034400.839478:0:8040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034400.839505:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636119424 00000100:00100000:0.0:1786034400.839509:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636119424 00000100:00100000:0.0:1786034400.839537:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1786034400.839543:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:8040:x1872792636119424:12345-0@lo:502: 00000100:00100000:0.0:1786034400.839744:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:8040:x1872792636119424:12345-0@lo:502: Request processed in 201us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034400.839751:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1786034400.839922:0:8040:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf180 going to sleep for 11 seconds 00000100:00100000:0.0:1786034400.839953:0:8040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8040:1872792636119424:0@lo:502: 00000020:01000000:0.0:1786034400.839978:0:8040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034400.839983:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034400.839984:0:8040:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1786034400.839987:0:8040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1786034400.840028:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1786034400.840043:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1786034400.840059:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb48 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.840068:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb48 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034400.840077:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1786034400.840079:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff964542f499c0 from 1 10000000:01000000:0.0:1786034400.840082:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1786034400.840105:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.840112:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.840121:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034400.840151:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636120064:0@lo:101: 00000100:00100000:0.0:1786034400.840293:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034400.840311:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf180 going to sleep for 11 seconds 00000100:00100000:2.0:1786034400.840568:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636120064 00000100:00100000:2.0:1786034400.840573:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636120064 00000100:00100000:2.0:1786034400.840602:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1786034400.840609:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636120064:12345-0@lo:101: 00010000:00010000:2.0:1786034400.840694:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034400.840707:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9645413f0800/0x490975051af3fb72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fb6b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034400.840727:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f0800/0x490975051af3fb72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fb6b expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034400.840737:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9645413f0800/0x490975051af3fb72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fb6b expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034400.840745:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0800, rc 0) 00000100:00100000:2.0:1786034400.840883:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636120064:12345-0@lo:101: Request processed in 274us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034400.840890:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1786034400.841002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.841023:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786034400.841029:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636119936:0@lo:400: 00000100:00100000:1.0:1786034400.841053:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.841078:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636119680:0@lo:400: 00000100:00100000:1.0:1786034400.841096:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034400.841111:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786034400.841116:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636119808:0@lo:400: 00000100:00100000:2.0:1786034400.841309:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636119552 00000100:00100000:2.0:1786034400.841313:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636119552 00000100:00100000:2.0:1786034400.841338:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636119936 00000100:00100000:2.0:1786034400.841340:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636119936 00000100:00100000:2.0:1786034400.841356:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636119680 00000100:00100000:2.0:1786034400.841358:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636119680 00000100:00100000:2.0:1786034400.841370:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786034400.841375:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636119552:12345-0@lo:400: 00000100:00100000:2.0:1786034400.841410:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636119552:12345-0@lo:400: Request processed in 34us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034400.841415:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786034400.841425:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786034400.841430:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636119936:12345-0@lo:400: 00000100:00100000:2.0:1786034400.841450:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636119936:12345-0@lo:400: Request processed in 21us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034400.841455:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786034400.841464:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786034400.841469:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636119680:12345-0@lo:400: 00000100:00100000:2.0:1786034400.841486:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636119680:12345-0@lo:400: Request processed in 18us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034400.841492:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1786034400.841541:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1786034400.841603:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d1c0700 x1872792636119680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034400.841623:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636119680:0@lo:400: 00010000:00080000:1.0:1786034400.841654:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d1c1f80 x1872792636119936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034400.841664:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636119936:0@lo:400: 00010000:00080000:1.0:1786034400.841672:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d1c2a00 x1872792636119552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034400.841692:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636119552:0@lo:400: 00000100:00100000:0.0:1786034400.841856:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636120064:0@lo:101: 00010000:00010000:0.0:1786034400.841871:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.841880:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fb72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034400.841921:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636120192:0@lo:501: 00000100:00100000:0.0:1786034400.841967:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034400.841985:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf180 going to sleep for 11 seconds 00000100:00080000:0.0:1786034400.842000:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034400.842042:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636120192 00000100:00100000:1.0:1786034400.842046:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636120192 00000100:00100000:1.0:1786034400.842068:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1786034400.842074:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636120192:12345-0@lo:501: 00000100:00100000:1.0:1786034400.842415:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636120192:12345-0@lo:501: Request processed in 340us (445us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786034400.842421:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1786034400.842487:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636120192:0@lo:501: 10000000:01000000:0.0:1786034400.842511:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1786034400.842517:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034400.842524:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1786034400.842577:0:6720:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff964551853800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113834 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1786034400.842582:0:6720:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1786034400.842586:0:6720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1786034400.842727:0:6720:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1786034400.842994:0:6720:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1786034400.843021:0:6720:0:(import.c:65:import_set_state_nolock()) ffff964551854800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786034400.843099:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1872792636119296:12345-0@lo:8: Request processed in 3886us (4341us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034400.843106:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786034400.843119:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636119808 00000100:00100000:3.0:1786034400.843122:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636119808 00000100:00080000:1.0:1786034400.843335:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786034400.843381:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786034400.843390:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636119808:12345-0@lo:400: 00000100:00100000:2.0:1786034400.843432:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636119808:12345-0@lo:400: Request processed in 44us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034400.843438:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1786034400.843498:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d1c2d80 x1872792636119808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034400.843509:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636119808:0@lo:400: 00010000:00080000:0.0:1786034400.843556:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96455a5b2680 x1872792636119296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786034410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034400.843564:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786034400.843571:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1786034400.843578:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1786034400.843582:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1786034400.843584:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9644469ab800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1786034400.843683:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1786034400.843689:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636119296:0@lo:8: 00000004:00080000:2.0:1786034400.843735:0:8041:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1786034400.843906:0:8041:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 237052081662ns, next at 0ns, rc = 0 00000004:00080000:3.0:1786034400.875442:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1786034400.880959:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1786034400.914943:0:8042:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1786034400.914970:0:8042:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1872792636120448:0@lo:7: 00000100:00100000:2.0:1786034400.915032:0:8042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034400.915067:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636120448 00000100:00100000:2.0:1786034400.915073:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636120448 00000100:00100000:2.0:1786034400.915119:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786034400.915313:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636120320:0@lo:13: 00000100:00100000:0.0:1786034400.915341:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786034400.915406:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786034400.915421:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636120320 00000100:00100000:1.0:1786034400.915424:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636120320 00000100:00100000:1.0:1786034400.915486:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786034400.915494:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1872792636120320:12345-0@lo:13: 00002000:00000024:1.0:1786034400.915522:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1786034400.915563:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1872792636120320:12345-0@lo:13: Request processed in 71us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034400.915570:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786034400.915598:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8042:x1872792636120448:12345-0@lo:7: 00002000:00080000:2.0:1786034400.922765:0:6719:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1786034400.922773:0:6719:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1786034400.923092:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8042:x1872792636120448:12345-0@lo:7: Request processed in 7961us (8056us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034400.923103:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786034400.923133:0:8042:0:(client.c:2702:ptlrpc_set_wait()) set ffff964551224240 going to sleep for 11 seconds 00010000:00080000:2.0:1786034400.924296:0:8042:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb5180 x1872792636120448/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1786034416 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034400.924312:0:8042:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1872792636120448:0@lo:7: 00000004:00080000:2.0:1786034400.924326:0:8042:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1786034400.924359:0:8042:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1872792636120576:0@lo:5: 00000100:00100000:2.0:1786034400.924394:0:8042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034400.924465:0:8042:0:(client.c:2702:ptlrpc_set_wait()) set ffff964551224240 going to sleep for 11 seconds 00010000:00080000:0.0:1786034400.925520:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb7b80 x1872792636120320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034400.925536:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636120320:0@lo:13: 00000100:00100000:3.0:1786034400.925978:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636120576 00000100:00100000:3.0:1786034400.925984:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636120576 00000100:00100000:3.0:1786034400.926055:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786034400.926064:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8042:x1872792636120576:12345-0@lo:5: 00002000:00080000:3.0:1786034400.926089:0:6721:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1786034400.926092:0:6721:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1786034400.926776:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8042:x1872792636120576:12345-0@lo:5: Request processed in 713us (2381us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1786034400.926784:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1786034400.927789:0:8042:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb5180 x1872792636120576/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786034416 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034400.927805:0:8042:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1872792636120576:0@lo:5: 00000004:00080000:2.0:1786034400.927817:0:8042:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1786034400.927873:0:8042:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1872792636120704:0@lo:700: 00000100:00100000:2.0:1786034400.927918:0:8042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034400.927954:0:8042:0:(client.c:2702:ptlrpc_set_wait()) set ffff964551224240 going to sleep for 11 seconds 00000100:00100000:2.0:1786034400.928331:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636120704 00000100:00100000:2.0:1786034400.928337:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636120704 00000100:00100000:2.0:1786034400.928373:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786034400.928379:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8042:x1872792636120704:12345-0@lo:700: 00000100:00100000:2.0:1786034400.928411:0:6728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6728:1872792636120832:0@lo:700: 00000100:00100000:2.0:1786034400.928440:0:6728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034400.928456:0:6728:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512249c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034400.928505:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636120832 00000100:00100000:1.0:1786034400.928509:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636120832 00000100:00100000:1.0:1786034400.928541:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786034400.928547:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6728:x1872792636120832:12345-0@lo:700: 40000000:02000000:1.0:1786034400.980561:0:5868:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1786034400.990433:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6728:x1872792636120832:12345-0@lo:700: Request processed in 61879us (61984us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034400.990447:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1786034400.990536:0:6728:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb7100 x1872792636120832/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1786034416 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034400.990552:0:6728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6728:1872792636120832:0@lo:700: 40000000:02000000:2.0:1786034400.990565:0:6728:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1786034401.065539:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1786034401.065559:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1786034401.065725:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8042:x1872792636120704:12345-0@lo:700: Request processed in 137342us (137803us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034401.065736:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1786034401.065781:0:8042:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb4380 x1872792636120704/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1786034416 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034401.065801:0:8042:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1786034401.065816:0:8042:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1872792636120704:0@lo:700: 00000004:02000040:3.0:1786034401.101575:0:8042:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1786034401.112083:0:8042:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e62300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1872792636120960:0@lo:5: 00000100:00100000:3.0:1786034401.112163:0:8042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034401.112353:0:8042:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560bf7480 going to sleep for 11 seconds 00000100:00100000:2.0:1786034401.112481:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636120960 00000100:00100000:2.0:1786034401.112489:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636120960 00000100:00100000:2.0:1786034401.112545:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786034401.112554:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8042:x1872792636120960:12345-0@lo:5: 00002000:00080000:0.0:1786034401.120108:0:6719:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1786034401.120333:0:6719:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1786034401.124553:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8042:x1872792636120960:12345-0@lo:5: Request processed in 11993us (12383us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1786034401.124564:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1786034401.124786:0:8042:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964549e62300 x1872792636120960/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786034417 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034401.124808:0:8042:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e62300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1872792636120960:0@lo:5: 00000004:00080000:2.0:1786034401.124963:0:8042:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1786034401.904591:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034402.930051:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034403.888092:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786034403.893992:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636121088:0@lo:13: 00000100:00100000:2.0:1786034403.894070:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034403.894220:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636121088 00000100:00100000:0.0:1786034403.894228:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636121088 00000100:00100000:0.0:1786034403.894291:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786034403.894301:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636121088:12345-0@lo:13: 00002000:00000024:0.0:1786034403.894330:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034403.894378:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636121088:12345-0@lo:13: Request processed in 79us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034403.894385:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1786034403.894422:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96455a5b3b80 x1872792636121088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034403.894445:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636121088:0@lo:13: 00000100:00080000:1.0:1786034403.894497:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786034403.952023:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034404.977692:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034405.937896:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636121600:0@lo:400: 00000100:00100000:1.0:1786034405.937970:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034405.938035:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786034405.938042:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636121216:0@lo:400: 00000100:00100000:1.0:1786034405.938072:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034405.938097:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636121728:0@lo:400: 00000100:00100000:1.0:1786034405.938121:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034405.938145:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636121344:0@lo:400: 00000100:00100000:1.0:1786034405.938167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034405.938181:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636121856:0@lo:400: 00000100:00100000:1.0:1786034405.938205:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034405.938220:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786034405.938226:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636121472:0@lo:400: 00000100:00100000:1.0:1786034405.938246:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034405.938272:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636121216 00000100:00100000:1.0:1786034405.938279:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636121216 00000100:00100000:1.0:1786034405.938320:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1786034405.938329:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636121216:12345-0@lo:400: 00000100:00100000:1.0:1786034405.938374:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636121216:12345-0@lo:400: Request processed in 47us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034405.938380:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1786034405.938427:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636121728 00000100:00100000:1.0:1786034405.938430:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636121728 00000100:00100000:1.0:1786034405.938459:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636121344 00000100:00100000:1.0:1786034405.938461:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636121344 00000100:00100000:1.0:1786034405.938471:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636121472 00000100:00100000:1.0:1786034405.938473:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636121472 00000100:00100000:1.0:1786034405.938500:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786034405.938508:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636121728:12345-0@lo:400: 00000100:00100000:1.0:1786034405.938539:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636121728:12345-0@lo:400: Request processed in 32us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034405.938545:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786034405.938556:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786034405.938562:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636121344:12345-0@lo:400: 00000100:00100000:1.0:1786034405.938591:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636121344:12345-0@lo:400: Request processed in 29us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034405.938597:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786034405.938608:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786034405.938613:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636121472:12345-0@lo:400: 00000100:00100000:1.0:1786034405.938652:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636121472:12345-0@lo:400: Request processed in 38us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034405.938658:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1786034405.938677:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786034405.938701:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964549e63b80 x1872792636121472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034405.938712:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636121472:0@lo:400: 00010000:00080000:1.0:1786034405.938722:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964549e62d80 x1872792636121344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034405.938742:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636121344:0@lo:400: 00000100:00100000:1.0:1786034405.938774:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636121216:0@lo:400: 00010000:00080000:1.0:1786034405.938783:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964549e61180 x1872792636121728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034405.938791:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636121728:0@lo:400: 00000100:00100000:3.0:1786034405.939042:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636121600 00000100:00100000:3.0:1786034405.939047:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636121600 00000100:00100000:3.0:1786034405.939087:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636121856 00000100:00100000:3.0:1786034405.939091:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636121856 00000100:00100000:3.0:1786034405.939107:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786034405.939113:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636121600:12345-0@lo:400: 00000100:00100000:3.0:1786034405.939150:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636121600:12345-0@lo:400: Request processed in 37us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034405.939156:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786034405.939169:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786034405.939175:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636121856:12345-0@lo:400: 00000100:00100000:3.0:1786034405.939204:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636121856:12345-0@lo:400: Request processed in 29us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034405.939209:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786034405.939774:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636121984:0@lo:13: 00000100:00100000:0.0:1786034405.939805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034405.940575:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636121984 00000100:00100000:2.0:1786034405.940581:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636121984 00000100:00100000:2.0:1786034405.940625:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786034405.940644:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1872792636121984:12345-0@lo:13: 00002000:00000024:2.0:1786034405.940672:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034405.940715:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1872792636121984:12345-0@lo:13: Request processed in 72us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034405.940722:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1786034405.941008:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786034405.941012:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786034405.941037:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964549e61f80 x1872792636121856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034405.941049:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636121856:0@lo:400: 00010000:00080000:1.0:1786034405.941075:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964549e62a00 x1872792636121600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034405.941083:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636121600:0@lo:400: 00010000:00080000:0.0:1786034405.943661:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb5180 x1872792636121984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034405.943683:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636121984:0@lo:13: 00010000:00010000:2.0:1786034406.002875:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786034406.645261:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1786034407.030015:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034408.055703:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034408.797940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034408.798215:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608833920 00000100:00100000:1.0:1786034408.798225:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608833920 00000100:00100000:1.0:1786034408.798275:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 114 00000100:00100000:1.0:1786034408.798283:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2361:x1872792608833920:12345-192.168.203.56@tcp:250: 00010000:00080000:1.0:1786034408.798308:0:5856:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from c13892d0-993e-46f4-852e-b7a576d2b5bb@192.168.203.56@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1786034408.798333:0:5856:0:(genops.c:1406:class_connect()) connect: client c13892d0-993e-46f4-852e-b7a576d2b5bb, cookie 0x490975051af3fb79 00000100:00080000:1.0:1786034408.798466:0:5856:0:(import.c:65:import_set_state_nolock()) ffff964548b37000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786034408.798530:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+5:2361:x1872792608833920:12345-192.168.203.56@tcp:250: Request processed in 246us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034408.798538:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 114 00000100:00100000:1.0:1786034408.805906:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034408.806032:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608833792 00000100:00100000:2.0:1786034408.806042:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608833792 00000100:00100000:2.0:1786034408.806098:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 115 00000100:00100000:2.0:1786034408.806108:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+5:5598:x1872792608833792:12345-192.168.203.56@tcp:101: 00010000:00010000:2.0:1786034408.806124:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034408.806141:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9645413f1e00/0x490975051af3fb80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7584e5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034408.806168:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f1e00/0x490975051af3fb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584e5 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034408.806179:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9645413f1e00/0x490975051af3fb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584e5 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034408.806210:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f1e00, rc 0) 00000100:00100000:2.0:1786034408.806267:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+6:5598:x1872792608833792:12345-192.168.203.56@tcp:101: Request processed in 160us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034408.806274:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 115 00000100:00100000:2.0:1786034408.817278:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034408.817517:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608834048 00000100:00100000:1.0:1786034408.817527:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608834048 00000100:00100000:1.0:1786034408.817583:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 116 00000100:00100000:1.0:1786034408.817593:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+6:5598:x1872792608834048:12345-192.168.203.56@tcp:501: 00000100:00100000:1.0:1786034408.818295:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+6:5598:x1872792608834048:12345-192.168.203.56@tcp:501: Request processed in 701us (1024us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786034408.818304:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 116 00000100:00100000:3.0:1786034408.824691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034408.826819:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608834176 00000100:00100000:1.0:1786034408.826870:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608834176 00000100:00100000:1.0:1786034408.826940:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 117 00000100:00100000:1.0:1786034408.826951:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+6:5598:x1872792608834176:12345-192.168.203.56@tcp:101: 00010000:00010000:1.0:1786034408.826968:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034408.826984:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964541653a00/0x490975051af3fb87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7584ec expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034408.827011:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964541653a00/0x490975051af3fb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584ec expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034408.827030:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964541653a00/0x490975051af3fb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584ec expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034408.827040:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964541653a00, rc 0) 00000100:00100000:1.0:1786034408.827113:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+7:5598:x1872792608834176:12345-192.168.203.56@tcp:101: Request processed in 164us (2431us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034408.827120:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 117 00000100:00100000:3.0:1786034408.834233:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034408.834357:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608834304 00000100:00100000:2.0:1786034408.834366:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608834304 00000100:00100000:2.0:1786034408.834418:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 118 00000100:00100000:2.0:1786034408.834427:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+7:5598:x1872792608834304:12345-192.168.203.56@tcp:501: 00000100:00100000:2.0:1786034408.834706:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+8:5598:x1872792608834304:12345-192.168.203.56@tcp:501: Request processed in 279us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034408.834714:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 118 00000100:00100000:3.0:1786034408.836914:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034408.837030:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608834432 00000100:00100000:2.0:1786034408.837037:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608834432 00000100:00100000:2.0:1786034408.837085:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 119 00000100:00100000:2.0:1786034408.837094:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+8:5598:x1872792608834432:12345-192.168.203.56@tcp:503: 00000100:00100000:2.0:1786034408.837383:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+8:5598:x1872792608834432:12345-192.168.203.56@tcp:503: Request processed in 290us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034408.837391:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 119 00000100:00100000:3.0:1786034408.842091:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034408.842532:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608834560 00000100:00100000:1.0:1786034408.842542:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608834560 00000100:00100000:1.0:1786034408.842610:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 120 00000100:00100000:1.0:1786034408.842619:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+8:5617:x1872792608834560:12345-192.168.203.56@tcp:502: 00000100:00100000:1.0:1786034408.842927:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+8:5617:x1872792608834560:12345-192.168.203.56@tcp:502: Request processed in 308us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034408.842934:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 120 00000100:00100000:3.0:1786034408.879900:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034408.880001:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608834688 00000100:00100000:1.0:1786034408.880011:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608834688 00000100:00100000:1.0:1786034408.880068:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 121 00000100:00100000:1.0:1786034408.880078:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+8:5617:x1872792608834688:12345-192.168.203.56@tcp:502: 00000100:00100000:1.0:1786034408.880347:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+8:5617:x1872792608834688:12345-192.168.203.56@tcp:502: Request processed in 270us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034408.880355:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 121 00000100:00100000:3.0:1786034408.886354:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034408.886454:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608834816 00000100:00100000:2.0:1786034408.886464:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608834816 00000100:00100000:2.0:1786034408.886525:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 122 00000100:00100000:2.0:1786034408.886534:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+8:5598:x1872792608834816:12345-192.168.203.56@tcp:101: 00010000:00010000:2.0:1786034408.886557:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034408.886580:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9645413f0400/0x490975051af3fb8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758516 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034408.886606:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f0400/0x490975051af3fb8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758516 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034408.886618:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9645413f0400/0x490975051af3fb8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758516 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034408.886627:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0400, rc 0) 00000100:00100000:2.0:1786034408.886680:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:5598:x1872792608834816:12345-192.168.203.56@tcp:101: Request processed in 147us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034408.886687:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 122 00000100:00100000:3.0:1786034408.906313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034408.906480:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608834944 00000100:00100000:2.0:1786034408.906490:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608834944 00000100:00100000:2.0:1786034408.906557:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 123 00000100:00100000:2.0:1786034408.906567:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:5598:x1872792608834944:12345-192.168.203.56@tcp:256: 20000000:01000000:2.0:1786034408.906593:0:5853:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1786034408.906615:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1786034408.906619:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1786034408.906622:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1786034408.906625:0:5853:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1786034408.913241:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:5598:x1872792608834944:12345-192.168.203.56@tcp:256: Request processed in 6666us (6927us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034408.913254:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 123 00000100:00100000:3.0:1786034408.915945:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034408.916031:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608835072 00000100:00100000:1.0:1786034408.916041:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608835072 00000100:00100000:1.0:1786034408.916096:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 124 00000100:00100000:1.0:1786034408.916106:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:5598:x1872792608835072:12345-192.168.203.56@tcp:101: 00010000:00010000:1.0:1786034408.916120:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034408.916152:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964574d01200/0x490975051af3fb95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75851d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034408.916178:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d01200/0x490975051af3fb95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75851d expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034408.916199:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964574d01200/0x490975051af3fb95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75851d expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034408.916208:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01200, rc 0) 00000100:00100000:1.0:1786034408.916253:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5598:x1872792608835072:12345-192.168.203.56@tcp:101: Request processed in 149us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034408.916261:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 124 00000100:00100000:3.0:1786034408.919710:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034408.919845:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608835200 00000100:00100000:2.0:1786034408.919853:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608835200 00000100:00100000:2.0:1786034408.919909:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 125 00000100:00100000:2.0:1786034408.919917:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5598:x1872792608835200:12345-192.168.203.56@tcp:501: 00000100:00100000:2.0:1786034408.920201:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5598:x1872792608835200:12345-192.168.203.56@tcp:501: Request processed in 284us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034408.920208:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 125 00000100:00100000:3.0:1786034408.924922:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034408.926914:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608835328 00000100:00100000:2.0:1786034408.926925:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608835328 00000100:00100000:2.0:1786034408.926987:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 126 00000100:00100000:2.0:1786034408.926996:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5598:x1872792608835328:12345-192.168.203.56@tcp:503: 00000100:00100000:2.0:1786034408.927380:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5598:x1872792608835328:12345-192.168.203.56@tcp:503: Request processed in 384us (2465us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034408.927388:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 126 00000100:00100000:3.0:1786034408.932686:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034408.932811:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608835456 00000100:00100000:1.0:1786034408.932820:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608835456 00000100:00100000:1.0:1786034408.932908:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 127 00000100:00100000:1.0:1786034408.932918:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5622:x1872792608835456:12345-192.168.203.56@tcp:502: 00000100:00100000:1.0:1786034408.933175:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5622:x1872792608835456:12345-192.168.203.56@tcp:502: Request processed in 257us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034408.933183:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 127 00000100:00100000:3.0:1786034408.935924:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034408.935994:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608835584 00000100:00100000:1.0:1786034408.936002:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608835584 00000100:00100000:1.0:1786034408.936209:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 128 00000100:00100000:1.0:1786034408.936218:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5622:x1872792608835584:12345-192.168.203.56@tcp:502: 00000100:00100000:1.0:1786034408.936400:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5622:x1872792608835584:12345-192.168.203.56@tcp:502: Request processed in 182us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034408.936408:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 128 00000100:00100000:3.0:1786034408.939347:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034408.939469:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608835712 00000100:00100000:0.0:1786034408.939476:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608835712 00000100:00100000:0.0:1786034408.939521:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 4 00000100:00100000:0.0:1786034408.939527:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2361:x1872792608835712:12345-192.168.203.56@tcp:38: 00010000:00080000:0.0:1786034408.939557:0:5863:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1786034408.939598:0:5863:0:(genops.c:1406:class_connect()) connect: client 696d4f9b-62ce-40a0-a754-08fa96a026cd, cookie 0x490975051af3fb9c 00000004:00100000:0.0:1786034408.939622:0:5863:0:(mdt_handler.c:7328:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1786034408.939636:0:5863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1786034408.992958:0:5863:0:(import.c:65:import_set_state_nolock()) ffff964551853000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786034408.993026:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2361:x1872792608835712:12345-192.168.203.56@tcp:38: Request processed in 53496us (53684us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034408.993036:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 4 00000100:00100000:3.0:1786034409.016644:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786034409.016668:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636122112:0@lo:13: 00000100:00100000:3.0:1786034409.016732:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034409.016934:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636122112 00000100:00100000:0.0:1786034409.016942:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636122112 00000100:00100000:0.0:1786034409.017006:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1786034409.017015:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636122112:12345-0@lo:13: 00002000:00000024:0.0:1786034409.017046:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034409.017100:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636122112:12345-0@lo:13: Request processed in 86us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034409.017107:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1786034409.017143:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96455a5b0380 x1872792636122112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034409.017160:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636122112:0@lo:13: 00000100:00080000:3.0:1786034409.017302:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786034409.082217:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034410.014563:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034410.014623:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608835840 00000100:00100000:2.0:1786034410.014636:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608835840 00000100:00080000:3.0:1786034410.014696:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034410.014789:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 5 00000100:00100000:2.0:1786034410.014801:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:0:x1872792608835840:12345-192.168.203.56@tcp:41: 00000004:00000024:2.0:1786034410.014888:0:6743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786034410.014974:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:0:x1872792608835840:12345-192.168.203.56@tcp:41: Request processed in 177us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034410.014982:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 5 00000100:00100000:3.0:1786034410.020365:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034410.032314:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608835968 00000100:00100000:0.0:1786034410.032333:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608835968 00000100:00100000:0.0:1786034410.032431:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 6 00000100:00100000:0.0:1786034410.032442:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:5598:x1872792608835968:12345-192.168.203.56@tcp:41: 00000004:00000024:0.0:1786034410.032486:0:5862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1786034410.032574:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:5598:x1872792608835968:12345-192.168.203.56@tcp:41: Request processed in 133us (12222us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034410.032582:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 6 00000100:00100000:3.0:1786034410.035733:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034410.035883:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608836096 00000100:00100000:0.0:1786034410.035894:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608836096 00000100:00100000:0.0:1786034410.035943:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 7 00000100:00100000:0.0:1786034410.035951:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:5598:x1872792608836096:12345-192.168.203.56@tcp:40: 00000100:00100000:0.0:1786034410.036174:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:5598:x1872792608836096:12345-192.168.203.56@tcp:40: Request processed in 222us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034410.036204:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 7 00000100:00100000:3.0:1786034410.042305:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034410.042522:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608836224 00000100:00100000:0.0:1786034410.042534:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608836224 00000100:00100000:0.0:1786034410.042586:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 8 00000100:00100000:0.0:1786034410.042595:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1872792608836224:12345-192.168.203.56@tcp:8: 00010000:00080000:0.0:1786034410.042633:0:6721:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1786034410.042669:0:6721:0:(genops.c:1406:class_connect()) connect: client 696d4f9b-62ce-40a0-a754-08fa96a026cd, cookie 0x490975051af3fba3 00002000:00100000:0.0:1786034410.042682:0:6721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 696d4f9b-62ce-40a0-a754-08fa96a026cd/ffff96444507b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113834 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786034410.042695:0:6721:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786034410.044647:0:6721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1786034410.044691:0:6721:0:(import.c:65:import_set_state_nolock()) ffff964445078000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786034410.044773:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2361:x1872792608836224:12345-192.168.203.56@tcp:8: Request processed in 2178us (2490us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034410.044783:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 8 00000100:00100000:3.0:1786034410.045541:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034410.045698:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608836352 00000100:00100000:2.0:1786034410.045707:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608836352 00000100:00100000:2.0:1786034410.045743:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00100000:2.0:1786034410.045751:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1872792608836352:12345-192.168.203.56@tcp:8: 00010000:00080000:2.0:1786034410.045779:0:6719:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:2.0:1786034410.045807:0:6719:0:(genops.c:1406:class_connect()) connect: client 696d4f9b-62ce-40a0-a754-08fa96a026cd, cookie 0x490975051af3fbaa 00002000:00100000:2.0:1786034410.045865:0:6719:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 696d4f9b-62ce-40a0-a754-08fa96a026cd/ffff9644458f2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113834 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786034410.045888:0:6719:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786034410.046314:0:6719:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1786034410.046561:0:6719:0:(import.c:65:import_set_state_nolock()) ffff9644458f6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786034410.046611:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2361:x1872792608836352:12345-192.168.203.56@tcp:8: Request processed in 859us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034410.046619:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00100000:3.0:1786034410.049580:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034410.050319:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608836480 00000100:00100000:2.0:1786034410.050330:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608836480 00000100:00100000:2.0:1786034410.050514:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:2.0:1786034410.050524:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:5598:x1872792608836480:12345-192.168.203.56@tcp:33: 00000100:00100000:1.0:1786034410.050903:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034410.051601:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608836608 00000100:00100000:2.0:1786034410.051607:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608836608 00000100:00100000:2.0:1786034410.051650:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 129 00000100:00100000:2.0:1786034410.051658:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608836608:12345-192.168.203.56@tcp:400: 00000100:00100000:2.0:1786034410.051728:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608836608:12345-192.168.203.56@tcp:400: Request processed in 70us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034410.051736:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 129 00010000:00010000:3.0:1786034410.112519:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786034410.114311:0:5864:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 63708us 00000004:00200000:3.0:1786034410.187297:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1786034410.188166:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:5598:x1872792608836480:12345-192.168.203.56@tcp:33: Request processed in 137638us (138590us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034410.188181:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:1.0:1786034410.496174:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034410.496360:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608836736 00000100:00100000:0.0:1786034410.496370:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608836736 00000100:00100000:0.0:1786034410.496426:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 8 00000100:00100000:0.0:1786034410.496435:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:5639:x1872792608836736:12345-192.168.203.56@tcp:101: 00010000:00010000:0.0:1786034410.496455:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034410.496478:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964582167800/0x490975051af3fbb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758547 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034410.496638:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964582166e00/0x490975051af3fbb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034410.496652:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964582166e00/0x490975051af3fbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034410.496680:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964582166e00/0x490975051af3fbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034410.496914:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1786034410.496918:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034410.496996:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964582166e00/0x490975051af3fbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034410.497022:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964582167800/0x490975051af3fbb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758547 expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034410.497040:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964582166e00/0x490975051af3fbb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758547 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034410.497048:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4700) 00010000:00010000:0.0:1786034410.497051:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034410.497054:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964582166e00, rc 0) 00000100:00100000:0.0:1786034410.497271:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:5639:x1872792608836736:12345-192.168.203.56@tcp:101: Request processed in 835us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034410.497279:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 8 00000100:00100000:0.0:1786034411.058728:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636122240:0@lo:13: 00000100:00100000:0.0:1786034411.058817:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034411.060056:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636122240 00000100:00100000:2.0:1786034411.060077:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636122240 00000100:00100000:2.0:1786034411.060166:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786034411.060178:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636122240:12345-0@lo:13: 00002000:00000024:2.0:1786034411.060204:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034411.060260:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636122240:12345-0@lo:13: Request processed in 86us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034411.060268:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1786034411.060480:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1786034411.060567:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb7100 x1872792636122240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034411.060579:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1786034411.060602:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636122240:0@lo:13: 00000100:00100000:3.0:1786034411.061245:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636122624:0@lo:400: 00000100:00100000:3.0:1786034411.061314:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034411.061356:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034411.061363:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636122752:0@lo:400: 00000100:00100000:3.0:1786034411.061390:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034411.061559:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636122496:0@lo:400: 00000100:00100000:0.0:1786034411.061590:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034411.061617:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786034411.061622:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636122368:0@lo:400: 00000100:00100000:0.0:1786034411.061646:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034411.061664:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636122880:0@lo:400: 00000100:00100000:0.0:1786034411.061683:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034411.061707:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636122752 00000100:00100000:0.0:1786034411.061711:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636122752 00000100:00100000:0.0:1786034411.061747:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786034411.061753:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636122752:12345-0@lo:400: 00000100:00100000:0.0:1786034411.061788:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636122752:12345-0@lo:400: Request processed in 35us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034411.061795:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786034411.061877:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636122624 00000100:00100000:1.0:1786034411.061882:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636122624 00000100:00100000:1.0:1786034411.061915:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636122496 00000100:00100000:1.0:1786034411.061917:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636122496 00000100:00100000:1.0:1786034411.061928:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636122880 00000100:00100000:1.0:1786034411.061930:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636122880 00000100:00100000:1.0:1786034411.061942:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786034411.061948:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636122624:12345-0@lo:400: 00000100:00100000:1.0:1786034411.061996:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636122624:12345-0@lo:400: Request processed in 49us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034411.062003:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786034411.062014:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786034411.062019:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636122496:12345-0@lo:400: 00000100:00100000:1.0:1786034411.062040:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636122496:12345-0@lo:400: Request processed in 21us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034411.062046:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786034411.062054:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786034411.062060:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636122880:12345-0@lo:400: 00000100:00100000:1.0:1786034411.062092:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636122880:12345-0@lo:400: Request processed in 32us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034411.062097:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786034411.062115:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636122368 00000100:00100000:1.0:1786034411.062118:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636122368 00000100:00100000:1.0:1786034411.062145:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1786034411.062152:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636122368:12345-0@lo:400: 00000100:00100000:1.0:1786034411.062180:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636122368:12345-0@lo:400: Request processed in 29us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034411.062186:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1786034411.063130:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636122368:0@lo:400: 00000100:00100000:0.0:1786034411.063145:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636122880:0@lo:400: 00000100:00100000:0.0:1786034411.063156:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636122496:0@lo:400: 00000100:00080000:3.0:1786034411.063280:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786034411.063294:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786034411.063314:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457e072680 x1872792636122752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034411.063325:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636122752:0@lo:400: 00000100:00100000:3.0:1786034411.063345:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636122624:0@lo:400: 00010000:00010000:3.0:1786034411.120031:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034412.144163:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034413.169060:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034413.573596:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034413.573778:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608836864 00000100:00100000:2.0:1786034413.573794:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608836864 00000100:00100000:2.0:1786034413.574915:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00100000:2.0:1786034413.574930:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:5692:x1872792608836864:12345-192.168.203.56@tcp:41: 00000004:00000024:2.0:1786034413.575007:0:6743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786034413.575094:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:5692:x1872792608836864:12345-192.168.203.56@tcp:41: Request processed in 169us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034413.575102:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00080000:3.0:1786034413.577088:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034413.579734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034413.579992:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608836992 00000100:00100000:0.0:1786034413.580004:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608836992 00000100:00100000:0.0:1786034413.580099:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00100000:0.0:1786034413.580110:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:5692:x1872792608836992:12345-192.168.203.56@tcp:13: 00002000:00000024:0.0:1786034413.580156:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034413.580230:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:5692:x1872792608836992:12345-192.168.203.56@tcp:13: Request processed in 123us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034413.580238:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00080000:3.0:1786034413.580399:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786034413.581666:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034413.582513:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608837120 00000100:00100000:0.0:1786034413.582543:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608837120 00000100:00100000:0.0:1786034413.582698:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:0.0:1786034413.582709:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:5692:x1872792608837120:12345-192.168.203.56@tcp:13: 00002000:00000024:0.0:1786034413.582747:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034413.582821:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:5692:x1872792608837120:12345-192.168.203.56@tcp:13: Request processed in 114us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034413.582887:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00080000:3.0:1786034413.589235:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1786034413.662391:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 696d4f9b-62ce-40a0-a754-08fa96a026cd 00000100:00100000:2.0:1786034414.128004:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786034414.128041:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636123008:0@lo:13: 00000100:00100000:2.0:1786034414.128126:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034414.128251:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636123008 00000100:00100000:0.0:1786034414.128268:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636123008 00000100:00100000:0.0:1786034414.128345:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786034414.128356:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636123008:12345-0@lo:13: 00002000:00000024:0.0:1786034414.128412:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034414.128466:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636123008:12345-0@lo:13: Request processed in 111us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034414.128474:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1786034414.128522:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96455a5b1f80 x1872792636123008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034414.128542:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636123008:0@lo:13: 00000100:00080000:2.0:1786034414.128659:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786034414.203453:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786034414.263678:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 696d4f9b-62ce-40a0-a754-08fa96a026cd 00000001:00100000:0.0:1786034414.760480:0:6746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 696d4f9b-62ce-40a0-a754-08fa96a026cd 00010000:00010000:2.0:1786034415.228169:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034415.483100:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034415.483136:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034415.483163:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034415.483196:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034415.483248:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608837504 00000100:00100000:1.0:1786034415.483259:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608837504 00000100:00100000:1.0:1786034415.483322:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608837632 00000100:00100000:1.0:1786034415.483325:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608837632 00000100:00100000:1.0:1786034415.483348:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00100000:1.0:1786034415.483359:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2363:x1872792608837504:12345-192.168.203.56@tcp:400: 00000100:00100000:1.0:1786034415.483463:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2363:x1872792608837504:12345-192.168.203.56@tcp:400: Request processed in 105us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034415.483471:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00100000:1.0:1786034415.483488:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:1.0:1786034415.483495:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2363:x1872792608837632:12345-192.168.203.56@tcp:400: 00000100:00100000:1.0:1786034415.483516:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2363:x1872792608837632:12345-192.168.203.56@tcp:400: Request processed in 22us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034415.483522:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:1.0:1786034415.483540:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608837376 00000100:00100000:1.0:1786034415.483543:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608837376 00000100:00100000:1.0:1786034415.483586:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 28 00000100:00100000:1.0:1786034415.483593:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608837376:12345-192.168.203.56@tcp:400: 00000100:00100000:1.0:1786034415.483621:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608837376:12345-192.168.203.56@tcp:400: Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034415.483627:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 28 00000100:00100000:2.0:1786034415.485555:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608837248 00000100:00100000:2.0:1786034415.485565:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608837248 00000100:00100000:2.0:1786034415.485631:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 131 00000100:00100000:2.0:1786034415.485639:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2363:x1872792608837248:12345-192.168.203.56@tcp:400: 00000100:00100000:2.0:1786034415.485697:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2363:x1872792608837248:12345-192.168.203.56@tcp:400: Request processed in 59us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034415.485704:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 131 00000100:00080000:2.0:1786034415.485737:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786034415.485742:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786034415.485745:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786034416.176238:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636123392:0@lo:400: 00000100:00100000:1.0:1786034416.176330:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034416.176415:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786034416.176421:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636123520:0@lo:400: 00000100:00100000:1.0:1786034416.176470:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034416.176530:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636123392 00000100:00100000:1.0:1786034416.176539:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636123392 00000100:00100000:1.0:1786034416.176617:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786034416.176628:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636123392:12345-0@lo:400: 00000100:00100000:1.0:1786034416.176687:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636123392:12345-0@lo:400: Request processed in 61us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034416.176694:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786034416.176720:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636123520 00000100:00100000:1.0:1786034416.176724:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636123520 00000100:00100000:1.0:1786034416.176767:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786034416.176773:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636123520:12345-0@lo:400: 00000100:00100000:1.0:1786034416.176816:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636123520:12345-0@lo:400: Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034416.176841:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1786034416.176858:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034416.176864:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786034416.176900:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457e071f80 x1872792636123520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034416.176915:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636123520:0@lo:400: 00000100:00100000:1.0:1786034416.176928:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636123392:0@lo:400: 00000100:00100000:2.0:1786034416.177225:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636123136:0@lo:400: 00000100:00100000:2.0:1786034416.177262:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034416.177299:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636123648:0@lo:400: 00000100:00100000:2.0:1786034416.177322:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034416.177341:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1786034416.177346:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636123264:0@lo:400: 00000100:00100000:2.0:1786034416.177364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034416.177379:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636123776:0@lo:400: 00000100:00100000:2.0:1786034416.177418:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034416.177447:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636123648 00000100:00100000:2.0:1786034416.177452:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636123648 00000100:00100000:2.0:1786034416.177484:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636123264 00000100:00100000:2.0:1786034416.177487:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636123264 00000100:00100000:2.0:1786034416.177522:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786034416.177529:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636123648:12345-0@lo:400: 00000100:00100000:2.0:1786034416.177565:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636123648:12345-0@lo:400: Request processed in 36us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034416.177583:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786034416.177598:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786034416.177604:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636123264:12345-0@lo:400: 00000100:00100000:2.0:1786034416.177631:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636123264:12345-0@lo:400: Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034416.177636:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786034416.177657:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636123776 00000100:00100000:2.0:1786034416.177660:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636123776 00000100:00100000:2.0:1786034416.177684:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786034416.177691:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636123776:12345-0@lo:400: 00000100:00100000:2.0:1786034416.177721:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636123776:12345-0@lo:400: Request processed in 30us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034416.177746:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1786034416.177764:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786034416.177767:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034416.177788:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636123264:0@lo:400: 00010000:00080000:2.0:1786034416.177798:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457e072a00 x1872792636123776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034416.177819:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636123776:0@lo:400: 00000100:00100000:2.0:1786034416.177851:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636123648:0@lo:400: 00000100:00100000:1.0:1786034416.178235:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636123136 00000100:00100000:1.0:1786034416.178240:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636123136 00000100:00100000:1.0:1786034416.178279:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1786034416.178287:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636123136:12345-0@lo:400: 00000100:00100000:1.0:1786034416.178339:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636123136:12345-0@lo:400: Request processed in 52us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034416.178351:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1786034416.178746:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636123136:0@lo:400: 00000100:00100000:3.0:1786034416.178939:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786034416.178952:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636123904:0@lo:13: 00000100:00100000:3.0:1786034416.178988:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034416.179122:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636123904 00000100:00100000:0.0:1786034416.179127:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636123904 00000100:00100000:0.0:1786034416.179166:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786034416.179174:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636123904:12345-0@lo:13: 00002000:00000024:0.0:1786034416.179207:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034416.179254:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636123904:12345-0@lo:13: Request processed in 81us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034416.179269:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1786034416.179390:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb5180 x1872792636123904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034416.179408:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636123904:0@lo:13: 00010000:00010000:3.0:1786034416.240194:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034417.265022:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786034417.938263:0:8338:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1786034418.288026:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034419.248351:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786034419.248381:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636124032:0@lo:13: 00000100:00100000:2.0:1786034419.248461:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034419.248687:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636124032 00000100:00100000:0.0:1786034419.248697:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636124032 00000100:00100000:0.0:1786034419.248776:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786034419.248796:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636124032:12345-0@lo:13: 00002000:00000024:0.0:1786034419.248859:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034419.248913:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636124032:12345-0@lo:13: Request processed in 119us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034419.248921:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1786034419.249041:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786034419.249081:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96455a5b1f80 x1872792636124032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034419.249102:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636124032:0@lo:13: 00010000:00010000:3.0:1786034419.319750:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034420.336014:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034420.573955:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034420.574000:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034420.574031:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608837760 00000100:00100000:0.0:1786034420.574042:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608837760 00000100:00100000:0.0:1786034420.574098:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 133 00000100:00100000:0.0:1786034420.574109:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2363:x1872792608837760:12345-192.168.203.56@tcp:400: 00000100:00100000:0.0:1786034420.574188:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2363:x1872792608837760:12345-192.168.203.56@tcp:400: Request processed in 81us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034420.574196:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 133 00000100:00100000:0.0:1786034420.574245:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608838016 00000100:00100000:0.0:1786034420.574249:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608838016 00000100:00100000:0.0:1786034420.574286:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 13 00000100:00100000:0.0:1786034420.574293:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2363:x1872792608838016:12345-192.168.203.56@tcp:400: 00000100:00100000:0.0:1786034420.574320:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2363:x1872792608838016:12345-192.168.203.56@tcp:400: Request processed in 28us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034420.574327:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 13 00000100:00080000:0.0:1786034420.574460:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786034420.578428:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034420.578480:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034420.578518:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608838144 00000100:00100000:0.0:1786034420.578527:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608838144 00000100:00100000:0.0:1786034420.578585:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:0.0:1786034420.578595:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608838144:12345-192.168.203.56@tcp:400: 00000100:00100000:0.0:1786034420.578666:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608838144:12345-192.168.203.56@tcp:400: Request processed in 73us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034420.578674:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00080000:0.0:1786034420.578694:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786034420.578875:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608837888 00000100:00100000:2.0:1786034420.578880:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608837888 00000100:00100000:2.0:1786034420.578918:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 32 00000100:00100000:2.0:1786034420.578926:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608837888:12345-192.168.203.56@tcp:400: 00000100:00100000:2.0:1786034420.578960:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608837888:12345-192.168.203.56@tcp:400: Request processed in 36us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034420.578982:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 32 00000100:00080000:0.0:1786034420.579035:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034421.296920:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786034421.296963:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636124160:0@lo:13: 00000100:00100000:3.0:1786034421.297053:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034421.297133:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636124160 00000100:00100000:3.0:1786034421.297142:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636124160 00000100:00100000:3.0:1786034421.297206:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786034421.297215:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636124160:12345-0@lo:13: 00002000:00000024:3.0:1786034421.297266:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034421.297313:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636124160:12345-0@lo:13: Request processed in 98us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034421.297320:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1786034421.297344:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1786034421.297377:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9645747b5500 x1872792636124160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034421.297395:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636124160:0@lo:13: 00000100:00100000:0.0:1786034421.309222:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636124544:0@lo:400: 00000100:00100000:0.0:1786034421.309312:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034421.309366:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786034421.309371:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636124416:0@lo:400: 00000100:00100000:0.0:1786034421.309389:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034421.309483:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636124288:0@lo:400: 00000100:00100000:2.0:1786034421.309521:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034421.309548:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636124800:0@lo:400: 00000100:00100000:2.0:1786034421.309568:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034421.309584:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786034421.309589:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636124672:0@lo:400: 00000100:00100000:2.0:1786034421.309609:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034421.309640:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636124544 00000100:00100000:2.0:1786034421.309648:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636124544 00000100:00100000:2.0:1786034421.309700:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636124416 00000100:00100000:2.0:1786034421.309702:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636124416 00000100:00100000:2.0:1786034421.309713:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636124800 00000100:00100000:2.0:1786034421.309715:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636124800 00000100:00100000:2.0:1786034421.309729:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1786034421.309737:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636124544:12345-0@lo:400: 00000100:00100000:2.0:1786034421.309798:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636124544:12345-0@lo:400: Request processed in 61us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034421.309806:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1786034421.309863:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786034421.309870:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636124416:12345-0@lo:400: 00000100:00100000:2.0:1786034421.309893:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636124416:12345-0@lo:400: Request processed in 24us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034421.309898:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786034421.309907:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786034421.309912:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636124800:12345-0@lo:400: 00000100:00100000:2.0:1786034421.309945:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636124800:12345-0@lo:400: Request processed in 33us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034421.309950:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786034421.309974:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636124672 00000100:00100000:2.0:1786034421.309977:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636124672 00000100:00100000:2.0:1786034421.310014:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786034421.310019:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636124672:12345-0@lo:400: 00000100:00100000:2.0:1786034421.310044:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636124672:12345-0@lo:400: Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034421.310049:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1786034421.310062:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786034421.310067:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1786034421.310108:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964542e25500 x1872792636124672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034421.310122:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636124672:0@lo:400: 00000100:00100000:2.0:1786034421.310131:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636124800:0@lo:400: 00000100:00100000:2.0:1786034421.310156:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636124416:0@lo:400: 00000100:00100000:2.0:1786034421.310165:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636124544:0@lo:400: 00000100:00100000:0.0:1786034421.310668:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636124288 00000100:00100000:0.0:1786034421.310672:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636124288 00000100:00100000:0.0:1786034421.310707:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1786034421.310713:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636124288:12345-0@lo:400: 00000100:00100000:0.0:1786034421.310751:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636124288:12345-0@lo:400: Request processed in 38us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034421.310757:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1786034421.312362:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636124288:0@lo:400: 00010000:00010000:2.0:1786034421.361382:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034422.390123:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786034422.931478:0:8487:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd6b6e9e0 20000000:00000080:1.0:1786034422.931498:0:8487:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96455190f800 uarg=0000000000000000 20000000:01000000:1.0:1786034422.931539:0:8487:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1786034422.931542:0:8487:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1786034422.931544:0:8487:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1786034422.931549:0:8487:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1786034422.931555:0:8487:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1786034422.931569:0:8487:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1786034422.931572:0:8487:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1786034422.931790:0:8487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1786034422.931793:0:8487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1786034422.932674:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1786034422.933368:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1786034422.933414:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1786034422.933441:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1786034422.933450:0:8487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1786034422.933452:0:8487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1786034422.934352:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1786034422.934626:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1786034422.934676:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1786034422.934709:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1786034422.934719:0:8487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1786034422.934721:0:8487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1786034422.935553:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1786034422.935917:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1786034422.935955:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1786034422.936063:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1786034422.936076:0:8487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1786034422.936078:0:8487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1786034422.939406:0:8491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1786034422.939802:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1786034422.939954:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1786034422.940047:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1786034422.940064:0:8487:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786034422.940170:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.940193:0:8487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964562313400/0x490975051af3fabc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fab5 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.940202:0:8487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9645413f0000/0x490975051af3fae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fadf expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.940210:0:8487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964582166800/0x490975051af3fb10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fb09 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.940217:0:8487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964582167600/0x490975051af3fb1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fb17 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.940224:0:8487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964562312600/0x490975051af3fb2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fb25 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.940231:0:8487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964562312000/0x490975051af3fb48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fb41 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.940238:0:8487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9645413f0800/0x490975051af3fb72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fb6b expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.940249:0:8487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9645413f1e00/0x490975051af3fb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584e5 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.940256:0:8487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964541653a00/0x490975051af3fb87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584ec expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.940264:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.940319:0:8487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964541653a00/0x490975051af3fb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584ec expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.940336:0:8487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964541653a00/0x490975051af3fb87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584ec expref: 9 pid: 5853 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.940353:0:8487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636124928:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034422.943782:0:8487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9645413f1e00/0x490975051af3fb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584e5 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.943804:0:8487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9645413f1e00/0x490975051af3fb80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584e5 expref: 9 pid: 5855 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.943844:0:8487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e071f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125056:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034422.943913:0:8487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9645413f0800/0x490975051af3fb72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fb6b expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.943921:0:8487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9645413f0800/0x490975051af3fb72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fb6b expref: 18 pid: 5856 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.943930:0:8487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e071880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125184:0@lo:104: 00000100:00100000:1.0:1786034422.943982:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786034422.944017:0:8487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964562312000/0x490975051af3fb48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fb41 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.944024:0:8487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964562312000/0x490975051af3fb48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fb41 expref: 18 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.944045:0:8487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e071500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125312:0@lo:104: 00000100:00100000:1.0:1786034422.944068:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786034422.944104:0:8487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964562312600/0x490975051af3fb2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fb25 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.944111:0:8487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964562312600/0x490975051af3fb2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fb25 expref: 18 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.944124:0:8487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125440:0@lo:104: 00010000:00010000:1.0:1786034422.944145:0:8487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964582167600/0x490975051af3fb1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fb17 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.944152:0:8487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964582167600/0x490975051af3fb1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fb17 expref: 18 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.944158:0:8487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125568:0@lo:104: 00010000:00010000:1.0:1786034422.944179:0:8487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964582166800/0x490975051af3fb10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fb09 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.944185:0:8487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964582166800/0x490975051af3fb10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fb09 expref: 18 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.944191:0:8487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125696:0@lo:104: 00010000:00010000:1.0:1786034422.944208:0:8487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9645413f0000/0x490975051af3fae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fadf expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.944214:0:8487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9645413f0000/0x490975051af3fae6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fadf expref: 18 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.944231:0:8487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125824:0@lo:104: 00010000:00010000:1.0:1786034422.944251:0:8487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964562313400/0x490975051af3fabc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fab5 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.944258:0:8487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964562313400/0x490975051af3fabc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fab5 expref: 18 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.944264:0:8487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125952:0@lo:104: 00000100:00100000:1.0:1786034422.944277:0:8487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786034422.944443:0:5844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1786034422.944463:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034422.944474:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034422.944482:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034422.944489:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034422.944496:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034422.944504:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636125184 00000100:00100000:3.0:1786034422.944511:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636125184 00000100:00100000:3.0:1786034422.944556:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636125312 00000100:00100000:3.0:1786034422.944558:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636125312 00000100:00100000:3.0:1786034422.944566:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636125440 00000100:00100000:3.0:1786034422.944568:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636125440 00000100:00100000:3.0:1786034422.944575:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636125568 00000100:00100000:3.0:1786034422.944577:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636125568 00000100:00100000:3.0:1786034422.944584:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636125696 00000100:00100000:3.0:1786034422.944592:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636125696 00000100:00100000:3.0:1786034422.944603:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636125824 00000100:00100000:3.0:1786034422.944604:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636125824 00000100:00100000:3.0:1786034422.944612:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636125952 00000100:00100000:3.0:1786034422.944613:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636125952 00000100:00100000:3.0:1786034422.944626:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786034422.944633:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+9:8487:x1872792636125184:12345-0@lo:104: 00010000:00010000:3.0:1786034422.944647:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fb72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.944716:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786034422.944722:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+9:8487:x1872792636125184:12345-0@lo:104: Request processed in 90us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034422.944741:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786034422.944771:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786034422.944776:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457477b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+8:8487:x1872792636125312:12345-0@lo:104: 00010000:00010000:3.0:1786034422.944783:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fb48 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.944812:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786034422.944816:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457477b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+8:8487:x1872792636125312:12345-0@lo:104: Request processed in 41us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034422.944843:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786034422.944881:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786034422.944887:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+7:8487:x1872792636125440:12345-0@lo:104: 00010000:00010000:3.0:1786034422.944893:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fb2c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.944919:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1786034422.944928:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+7:8487:x1872792636125440:12345-0@lo:104: Request processed in 42us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034422.944936:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786034422.944947:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786034422.944951:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+6:8487:x1872792636125568:12345-0@lo:104: 00010000:00010000:3.0:1786034422.944958:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fb1e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945313:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1786034422.945319:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+6:8487:x1872792636125568:12345-0@lo:104: Request processed in 367us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034422.945346:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786034422.945359:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786034422.945365:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+5:8487:x1872792636125696:12345-0@lo:104: 00010000:00010000:3.0:1786034422.945374:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fb10 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945396:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1786034422.945400:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+5:8487:x1872792636125696:12345-0@lo:104: Request processed in 36us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034422.945425:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786034422.945435:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786034422.945440:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+4:8487:x1872792636125824:12345-0@lo:104: 00010000:00010000:3.0:1786034422.945446:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fae6 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945466:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1786034422.945476:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+4:8487:x1872792636125824:12345-0@lo:104: Request processed in 36us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034422.945502:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786034422.945512:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786034422.945517:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:8487:x1872792636125952:12345-0@lo:104: 00010000:00010000:3.0:1786034422.945524:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fabc expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945546:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1786034422.945550:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:8487:x1872792636125952:12345-0@lo:104: Request processed in 33us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034422.945556:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1786034422.945576:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1786034422.945583:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fb72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945591:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964582167000 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:3.0:1786034422.945596:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fb72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945606:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fb72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786034422.945615:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fb72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034422.945621:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786034422.945659:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945675:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786034422.945694:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945702:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fb6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945717:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1786034422.945720:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fb48 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945725:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964541653400 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:3.0:1786034422.945729:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fb48 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945736:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fb48 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786034422.945743:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fb48 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034422.945760:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786034422.945772:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb48 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945779:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786034422.945783:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb48 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945790:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964541653400/0x490975051af3fb41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb48 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945806:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786034422.945810:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fb2c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945816:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964541653e00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:3.0:1786034422.945820:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fb2c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945847:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fb2c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786034422.945854:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fb2c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034422.945860:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786034422.945871:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb2c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945876:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786034422.945891:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb2c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945898:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964541653e00/0x490975051af3fb25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb2c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945907:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786034422.945910:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fb1e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945924:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964541653600 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:3.0:1786034422.945928:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fb1e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945935:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fb1e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786034422.945940:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fb1e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034422.945946:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786034422.945957:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb1e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.945963:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786034422.946084:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786034422.946105:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fb10 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946113:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964541652e00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:2.0:1786034422.946116:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fb10 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946124:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fb10 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786034422.946132:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fb10 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786034422.946137:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786034422.946152:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb10 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946159:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786034422.946163:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb10 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946170:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964541652e00/0x490975051af3fb09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb10 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946182:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786034422.946185:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fae6 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946191:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312200 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:2.0:1786034422.946194:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fae6 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946209:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fae6 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786034422.946216:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fae6 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786034422.946221:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786034422.946231:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fae6 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946236:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786034422.946239:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fae6 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946245:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964562312200/0x490975051af3fadf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fae6 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946254:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786034422.946256:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fabc expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946262:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964541652000 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:2.0:1786034422.946265:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fabc expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946272:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fabc expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786034422.946278:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fabc expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786034422.946288:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786034422.946299:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fabc expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946304:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786034422.946308:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fabc expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946315:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964541652000/0x490975051af3fab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fabc expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946323:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034422.946325:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034422.946326:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034422.946341:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636126080:0@lo:103: 00000100:00100000:2.0:1786034422.946386:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034422.946411:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636126592:0@lo:103: 00000100:00100000:2.0:1786034422.946426:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034422.946444:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786034422.946449:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636126208:0@lo:103: 00000100:00100000:2.0:1786034422.946464:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034422.946476:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636126720:0@lo:103: 00000100:00100000:2.0:1786034422.946492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034422.946515:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636126464:0@lo:103: 00000100:00100000:2.0:1786034422.946535:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034422.946544:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786034422.946548:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636126336:0@lo:103: 00000100:00100000:2.0:1786034422.946585:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034422.946594:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636126848:0@lo:103: 00000100:00100000:2.0:1786034422.946612:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034422.946634:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636126080 00000100:00100000:2.0:1786034422.946641:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636126080 00010000:00010000:2.0:1786034422.946669:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9645413f0800/0x490975051af3fb72 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fb6b expref: 19 pid: 5856 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034422.946688:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636126592 00000100:00100000:2.0:1786034422.946691:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636126592 00010000:00010000:2.0:1786034422.946701:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964582166800/0x490975051af3fb10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fb09 expref: 20 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034422.946710:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636126208 00000100:00100000:2.0:1786034422.946712:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636126208 00010000:00010000:2.0:1786034422.946721:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964562312000/0x490975051af3fb48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fb41 expref: 21 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034422.946730:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636126720 00000100:00100000:2.0:1786034422.946732:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636126720 00010000:00010000:2.0:1786034422.946739:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9645413f0000/0x490975051af3fae6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fadf expref: 22 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034422.946759:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636126464 00000100:00100000:2.0:1786034422.946761:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636126464 00010000:00010000:2.0:1786034422.946771:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964582167600/0x490975051af3fb1e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fb17 expref: 23 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034422.946781:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636126336 00000100:00100000:2.0:1786034422.946783:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636126336 00010000:00010000:2.0:1786034422.946791:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964562312600/0x490975051af3fb2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fb25 expref: 24 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034422.946812:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636126848 00000100:00100000:2.0:1786034422.946814:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636126848 00010000:00010000:2.0:1786034422.946840:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964562313400/0x490975051af3fabc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fab5 expref: 25 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034422.946851:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786034422.946858:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+25:3307:x1872792636126080:12345-0@lo:103: 00010000:00010000:2.0:1786034422.946869:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034422.946875:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9645413f0800/0x490975051af3fb72 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fb6b expref: 25 pid: 5856 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946885:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9645413f0800/0x490975051af3fb72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fb6b expref: 25 pid: 5856 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946902:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034422.946930:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+25:3307:x1872792636126080:12345-0@lo:103: Request processed in 73us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034422.946942:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786034422.946956:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786034422.946960:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+24:3307:x1872792636126592:12345-0@lo:103: 00010000:00010000:2.0:1786034422.946977:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034422.946982:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964582166800/0x490975051af3fb10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fb09 expref: 24 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946990:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964582166800/0x490975051af3fb10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fb09 expref: 24 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.946998:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034422.947021:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+24:3307:x1872792636126592:12345-0@lo:103: Request processed in 61us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034422.947031:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786034422.947042:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786034422.947047:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+23:3307:x1872792636126208:12345-0@lo:103: 00010000:00010000:2.0:1786034422.947053:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034422.947057:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964562312000/0x490975051af3fb48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fb41 expref: 23 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.947064:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964562312000/0x490975051af3fb48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fb41 expref: 23 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.947072:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034422.947086:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+23:3307:x1872792636126208:12345-0@lo:103: Request processed in 39us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034422.947093:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786034422.947102:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786034422.947107:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+22:3307:x1872792636126720:12345-0@lo:103: 00010000:00010000:2.0:1786034422.947112:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034422.947115:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9645413f0000/0x490975051af3fae6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fadf expref: 22 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.947122:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9645413f0000/0x490975051af3fae6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fadf expref: 22 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.947129:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034422.947143:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+22:3307:x1872792636126720:12345-0@lo:103: Request processed in 37us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034422.947155:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786034422.947170:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786034422.947175:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+21:3310:x1872792636126464:12345-0@lo:103: 00010000:00010000:2.0:1786034422.947181:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034422.947185:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964582167600/0x490975051af3fb1e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fb17 expref: 21 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.947192:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964582167600/0x490975051af3fb1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fb17 expref: 21 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.947200:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034422.947220:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+21:3310:x1872792636126464:12345-0@lo:103: Request processed in 45us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034422.947226:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786034422.947235:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786034422.947239:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+20:3310:x1872792636126336:12345-0@lo:103: 00010000:00010000:2.0:1786034422.947245:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034422.947249:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964562312600/0x490975051af3fb2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fb25 expref: 20 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.947257:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964562312600/0x490975051af3fb2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fb25 expref: 20 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.947266:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034422.947281:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+20:3310:x1872792636126336:12345-0@lo:103: Request processed in 41us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034422.947306:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786034422.947314:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786034422.947319:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a063050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636126848:12345-0@lo:103: 00010000:00010000:2.0:1786034422.947326:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034422.947335:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964562313400/0x490975051af3fabc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fab5 expref: 19 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.947343:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964562313400/0x490975051af3fabc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fab5 expref: 19 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.947353:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034422.947369:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a063050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636126848:12345-0@lo:103: Request processed in 50us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034422.947394:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786034422.947458:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636126336:0@lo:103: 00000100:00100000:2.0:1786034422.947466:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636126848:0@lo:103: 00000100:00100000:2.0:1786034422.947473:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636126464:0@lo:103: 00000100:00100000:2.0:1786034422.947499:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636126208:0@lo:103: 00000100:00100000:2.0:1786034422.947505:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636126720:0@lo:103: 00000100:00100000:2.0:1786034422.947511:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636126080:0@lo:103: 00000100:00100000:2.0:1786034422.947517:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636126592:0@lo:103: 00010000:00010000:3.0:1786034422.947961:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb1e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.948021:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964541653600/0x490975051af3fb17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fb1e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034422.948043:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034422.948045:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034422.948047:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034422.948055:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034422.948174:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f0800/0x490975051af3fb72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fb6b expref: 18 pid: 5856 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.948187:0:8487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e071880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125184:0@lo:104: 00010000:00010000:1.0:1786034422.948197:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964562312000/0x490975051af3fb48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fb41 expref: 17 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.948205:0:8487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e071500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125312:0@lo:104: 00010000:00010000:1.0:1786034422.948215:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964562312600/0x490975051af3fb2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fb25 expref: 16 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.948222:0:8487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125440:0@lo:104: 00010000:00010000:1.0:1786034422.948230:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964582167600/0x490975051af3fb1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fb17 expref: 15 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.948237:0:8487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125568:0@lo:104: 00010000:00010000:1.0:1786034422.948246:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964582166800/0x490975051af3fb10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fb09 expref: 14 pid: 5855 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.948268:0:8487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125696:0@lo:104: 00010000:00010000:1.0:1786034422.948278:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f0000/0x490975051af3fae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fadf expref: 13 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.948285:0:8487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125824:0@lo:104: 00010000:00010000:1.0:1786034422.948293:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964562313400/0x490975051af3fabc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fab5 expref: 12 pid: 5853 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034422.948300:0:8487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125952:0@lo:104: 00000100:00100000:1.0:1786034422.961138:0:8487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636124928:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034422.961153:0:8487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e071f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1872792636125056:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034422.961207:0:8487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034422.965013:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034422.965049:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034422.969397:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608838400 00000100:00100000:1.0:1786034422.969414:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608838400 00000100:00100000:2.0:1786034422.971801:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608838272 00000100:00100000:2.0:1786034422.971811:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608838272 00010000:00010000:2.0:1786034422.971877:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964541653a00/0x490975051af3fb87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584ec expref: 11 pid: 5853 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034422.971918:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 19 00000100:00100000:2.0:1786034422.971928:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c13892d0-993e-46f4-852e-b7a576d2b5bb+11:2362:x1872792608838272:12345-192.168.203.56@tcp:103: 00010000:00010000:2.0:1786034422.971946:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034422.971967:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964541653a00/0x490975051af3fb87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584ec expref: 11 pid: 5853 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.971982:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964541653a00/0x490975051af3fb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584ec expref: 11 pid: 5853 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.972003:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964541653a00/0x490975051af3fb87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584ec expref: 11 pid: 5853 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034422.972022:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034422.972259:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608838272:12345-192.168.203.56@tcp:103: Request processed in 330us (7207us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034422.972276:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 19 00010000:00010000:0.0:1786034422.974365:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9645413f1e00/0x490975051af3fb80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584e5 expref: 9 pid: 5855 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034422.975272:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00100000:0.0:1786034422.975286:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:2362:x1872792608838400:12345-192.168.203.56@tcp:103: 00010000:00010000:0.0:1786034422.975303:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034422.975310:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9645413f1e00/0x490975051af3fb80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584e5 expref: 9 pid: 5855 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034422.975323:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9645413f1e00/0x490975051af3fb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584e5 expref: 9 pid: 5855 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034422.975341:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f1e00/0x490975051af3fb80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7584e5 expref: 9 pid: 5855 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034422.975359:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034422.975367:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034422.975384:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034422.975390:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034422.975397:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034422.975404:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034422.975420:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00600 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034422.975424:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034422.975431:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034422.975451:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034422.975461:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034422.975522:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c13892d0-993e-46f4-852e-b7a576d2b5bb+8:2362:x1872792608838400:12345-192.168.203.56@tcp:103: Request processed in 241us (10519us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034422.975530:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 20 00010000:00010000:1.0:1786034422.975594:0:8487:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.975603:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034422.975609:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964574d00600/0x490975051af3fbbf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034423.411333:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034423.649337:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034423.649451:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608838528 00000100:00100000:1.0:1786034423.649464:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608838528 00000100:00100000:0.0:1786034423.649596:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 135 00000100:00100000:0.0:1786034423.649610:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+8:5613:x1872792608838528:12345-192.168.203.56@tcp:101: 00010000:00010000:0.0:1786034423.649632:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034423.649658:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964582166a00/0x490975051af3fbc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75854e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034423.649692:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964582166a00/0x490975051af3fbc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75854e expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034423.649705:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964582166a00/0x490975051af3fbc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75854e expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034423.649716:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964582166a00, rc 0) 00000100:00100000:0.0:1786034423.649814:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:5613:x1872792608838528:12345-192.168.203.56@tcp:101: Request processed in 207us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034423.649874:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 135 00000100:00100000:3.0:1786034423.656812:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034423.657070:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608838656 00000100:00100000:1.0:1786034423.657097:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608838656 00000100:00100000:1.0:1786034423.657165:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 136 00000100:00100000:1.0:1786034423.657178:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:5613:x1872792608838656:12345-192.168.203.56@tcp:501: 00000100:00100000:1.0:1786034423.657636:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:5613:x1872792608838656:12345-192.168.203.56@tcp:501: Request processed in 460us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034423.657645:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 136 00000100:00100000:3.0:1786034423.661330:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034423.664643:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608838784 00000100:00100000:0.0:1786034423.664661:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608838784 00000100:00100000:0.0:1786034423.664764:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 137 00000100:00100000:0.0:1786034423.664775:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:5613:x1872792608838784:12345-192.168.203.56@tcp:503: 00000100:00100000:0.0:1786034423.665091:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:5613:x1872792608838784:12345-192.168.203.56@tcp:503: Request processed in 317us (3771us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034423.665101:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 137 00000100:00100000:0.0:1786034423.676272:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034423.681141:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608838912 00000100:00100000:1.0:1786034423.681161:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608838912 00000100:00100000:1.0:1786034423.681248:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 138 00000100:00100000:1.0:1786034423.681260:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:6080:x1872792608838912:12345-192.168.203.56@tcp:502: 00000100:00100000:1.0:1786034423.681611:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:6080:x1872792608838912:12345-192.168.203.56@tcp:502: Request processed in 352us (5353us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034423.681621:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 138 00000100:00100000:3.0:1786034423.689808:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034423.690642:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608839040 00000100:00100000:1.0:1786034423.690655:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608839040 00000100:00100000:1.0:1786034423.690733:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 139 00000100:00100000:1.0:1786034423.690755:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:6080:x1872792608839040:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786034423.691115:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:6080:x1872792608839040:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 370us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034423.691124:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 139 00000100:00100000:0.0:1786034423.697057:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034423.697872:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608839168 00000100:00100000:1.0:1786034423.697884:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608839168 00000100:00100000:1.0:1786034423.697957:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 140 00000100:00100000:1.0:1786034423.697968:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:5613:x1872792608839168:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786034423.697989:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034423.698028:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964574d00600/0x490975051af3fbcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758555 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034423.698062:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d00600/0x490975051af3fbcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758555 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034423.698075:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964574d00600/0x490975051af3fbcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758555 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034423.698087:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00600, rc 0) 00000100:00100000:1.0:1786034423.698161:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5613:x1872792608839168:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 Request processed in 193us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034423.698174:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 140 00000100:00100000:3.0:1786034423.704508:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034423.704786:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608839296 00000100:00100000:2.0:1786034423.704799:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608839296 00000100:00100000:2.0:1786034423.704898:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 141 00000100:00100000:2.0:1786034423.704909:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5613:x1872792608839296:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034423.705310:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5613:x1872792608839296:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 Request processed in 401us (815us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786034423.705318:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 141 10000000:01000000:2.0:1786034424.368096:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786034424.368107:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96457642c000 from 39 10000000:01000000:2.0:1786034424.368114:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786034424.368179:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034424.368192:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034424.368225:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034424.368254:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636126976:0@lo:101: 00000100:00100000:2.0:1786034424.368336:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034424.368404:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454f664cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034424.372038:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636126976 00000100:00100000:1.0:1786034424.372057:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636126976 00000100:00100000:1.0:1786034424.372147:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1786034424.372160:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+12:5858:x1872792636126976:12345-0@lo:101: 00010000:00010000:1.0:1786034424.372180:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034424.372202:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964574d01400/0x490975051af3fbdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fbd4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034424.372237:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d01400/0x490975051af3fbdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fbd4 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034424.372249:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964574d01400/0x490975051af3fbdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fbd4 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034424.372259:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01400, rc 0) 00000100:00100000:1.0:1786034424.372350:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:5858:x1872792636126976:12345-0@lo:101: Request processed in 193us (4013us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034424.372372:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1786034424.372616:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636127104:0@lo:13: 00000100:00100000:2.0:1786034424.372660:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034424.372815:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636127104 00000100:00100000:0.0:1786034424.372820:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636127104 00000100:00100000:0.0:1786034424.372916:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786034424.372924:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636127104:12345-0@lo:13: 00002000:00000024:0.0:1786034424.372959:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034424.373004:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636127104:12345-0@lo:13: Request processed in 81us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034424.373011:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1786034424.373054:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964542e24700 x1872792636127104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034424.373075:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636127104:0@lo:13: 00000100:00080000:2.0:1786034424.373526:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786034424.375126:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636126976:0@lo:101: 00010000:00010000:3.0:1786034424.375156:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fbdb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.375169:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fbdb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034424.375250:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636127232:0@lo:501: 00000100:00100000:3.0:1786034424.375306:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034424.375348:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964559e370c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034424.375415:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636127232 00000100:00100000:1.0:1786034424.375421:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636127232 00000100:00100000:1.0:1786034424.375469:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1786034424.375477:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:5858:x1872792636127232:12345-0@lo:501: 00000100:00100000:1.0:1786034424.375808:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:5858:x1872792636127232:12345-0@lo:501: Request processed in 330us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034424.375816:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1786034424.376170:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636127232:0@lo:501: 00000100:00100000:0.0:1786034424.376206:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636127360:0@lo:503: 00000100:00100000:0.0:1786034424.376254:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034424.376281:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455110e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034424.376329:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636127360 00000100:00100000:2.0:1786034424.376334:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636127360 00000100:00100000:2.0:1786034424.376366:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1786034424.376373:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:5858:x1872792636127360:12345-0@lo:503: 00000100:00100000:2.0:1786034424.376542:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:5858:x1872792636127360:12345-0@lo:503: Request processed in 169us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034424.376548:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1786034424.376618:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636127360:0@lo:503: 00000100:00100000:3.0:1786034424.378107:0:8503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8503:1872792636127488:0@lo:502: 00000100:00100000:3.0:1786034424.378171:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034424.378201:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636127488 00000100:00100000:3.0:1786034424.378207:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636127488 00000100:00100000:3.0:1786034424.378240:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1786034424.378247:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:8503:x1872792636127488:12345-0@lo:502: 00000100:00100000:3.0:1786034424.378460:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:8503:x1872792636127488:12345-0@lo:502: Request processed in 212us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.378466:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1786034424.378505:0:8503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.378521:0:8503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8503:1872792636127488:0@lo:502: 00000100:00100000:3.0:1786034424.378560:0:8503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8503:1872792636127616:0@lo:502: 00000100:00100000:3.0:1786034424.378587:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034424.378602:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636127616 00000100:00100000:3.0:1786034424.378610:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636127616 00000100:00100000:3.0:1786034424.378624:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1786034424.378629:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:8503:x1872792636127616:12345-0@lo:502: 00000100:00100000:3.0:1786034424.378768:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:8503:x1872792636127616:12345-0@lo:502: Request processed in 137us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.378775:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1786034424.378801:0:8503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.378813:0:8503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8503:1872792636127616:0@lo:502: 00000040:00080000:3.0:1786034424.378855:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1786034424.378916:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1786034424.378932:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786034424.378943:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fbdb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.378956:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fbdb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034424.378967:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1786034424.378970:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1786034424.378973:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1786034424.379001:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.379010:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.379020:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034424.379033:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636127744:0@lo:101: 00000100:00100000:3.0:1786034424.379066:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034424.379084:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.379097:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636127744 00000100:00100000:3.0:1786034424.379100:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636127744 00000100:00100000:3.0:1786034424.379116:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1786034424.379121:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+13:5858:x1872792636127744:12345-0@lo:101: 00010000:00010000:3.0:1786034424.379130:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034424.379143:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964562312400/0x490975051af3fbe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fbe2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.379166:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964562312400/0x490975051af3fbe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fbe2 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.379176:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964562312400/0x490975051af3fbe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fbe2 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.379186:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312400, rc 0) 00000100:00100000:3.0:1786034424.379213:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636127744:12345-0@lo:101: Request processed in 91us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.379220:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1786034424.379248:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636127744:0@lo:101: 00010000:00010000:3.0:1786034424.379258:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fbe9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.379266:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fbe9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034424.379301:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636127872:0@lo:501: 00000100:00100000:3.0:1786034424.379335:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034424.379349:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560a95900 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.379361:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636127872 00000100:00100000:3.0:1786034424.379364:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636127872 00000100:00100000:3.0:1786034424.379379:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1786034424.379384:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636127872:12345-0@lo:501: 00000100:00100000:3.0:1786034424.379599:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636127872:12345-0@lo:501: Request processed in 213us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.379606:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1786034424.379634:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636127872:0@lo:501: 00000100:00100000:3.0:1786034424.379656:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636128000:0@lo:503: 00000100:00100000:3.0:1786034424.379689:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034424.379702:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560a95900 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.379713:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636128000 00000100:00100000:3.0:1786034424.379716:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636128000 00000100:00100000:3.0:1786034424.379732:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1786034424.379747:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636128000:12345-0@lo:503: 00000100:00100000:3.0:1786034424.379922:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636128000:12345-0@lo:503: Request processed in 184us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.379929:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1786034424.379963:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636128000:0@lo:503: 00000100:00100000:1.0:1786034424.381459:0:8504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8504:1872792636128128:0@lo:502: 00000100:00100000:1.0:1786034424.381505:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034424.381531:0:8504:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645595b7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786034424.382465:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636128128 00000100:00100000:1.0:1786034424.382472:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636128128 00000100:00100000:1.0:1786034424.382507:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1786034424.382514:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:8504:x1872792636128128:12345-0@lo:502: 00000100:00100000:1.0:1786034424.390106:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:8504:x1872792636128128:12345-0@lo:502: Request processed in 7579us (8588us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034424.390123:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1786034424.391752:0:8504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8504:1872792636128128:0@lo:502: 00000020:01000000:0.0:1786034424.391808:0:8504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786034424.391868:0:8504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034424.391871:0:8504:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1786034424.391879:0:8504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1786034424.391934:0:8504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8504:1872792636128256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034424.392017:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034424.392071:0:8504:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455110e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034424.392892:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636128256 00000100:00100000:2.0:1786034424.392901:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636128256 00000100:00100000:2.0:1786034424.392973:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1786034424.392984:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:8504:x1872792636128256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786034424.393249:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:8504:x1872792636128256:12345-0@lo:502:llog_process_th.0 Request processed in 265us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034424.393256:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1786034424.396132:0:8504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8504:1872792636128256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786034424.396188:0:8504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786034424.396201:0:8504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034424.396203:0:8504:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1786034424.396223:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1786034424.399615:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1786034424.399654:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1786034424.399670:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fbe9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034424.399704:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fbe9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786034424.399717:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786034424.399720:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff964548917000 from 39 10000000:01000000:2.0:1786034424.399723:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786034424.399782:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034424.399792:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034424.399804:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034424.399873:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636128384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786034424.400054:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034424.400101:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454f664780 going to sleep for 11 seconds 00000100:00100000:1.0:1786034424.401368:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636128384 00000100:00100000:1.0:1786034424.401380:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636128384 00000100:00100000:1.0:1786034424.401447:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1786034424.401458:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:5858:x1872792636128384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786034424.401485:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034424.401501:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964574d00200/0x490975051af3fbf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fbf0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034424.401530:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d00200/0x490975051af3fbf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fbf0 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034424.401541:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964574d00200/0x490975051af3fbf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fbf0 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034424.401551:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00200, rc 0) 00000100:00100000:1.0:1786034424.401628:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636128384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034424.401636:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1786034424.401745:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636128384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786034424.401765:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034424.401776:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034424.401875:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636128512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034424.401906:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034424.401931:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455110e540 going to sleep for 11 seconds 00000100:00100000:1.0:1786034424.410255:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636128512 00000100:00100000:1.0:1786034424.410276:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636128512 00000100:00100000:1.0:1786034424.410361:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1786034424.410373:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636128512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786034424.410775:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636128512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 404us (8867us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034424.410783:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1786034424.410974:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636128512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034424.411040:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636128640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034424.411095:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034424.411137:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455110e540 going to sleep for 11 seconds 00000100:00100000:0.0:1786034424.411156:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636128640 00000100:00100000:0.0:1786034424.411160:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636128640 00000100:00100000:0.0:1786034424.411187:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1786034424.411192:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636128640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034424.411373:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636128640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034424.411380:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1786034424.411416:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636128640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786034424.420839:0:8505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8505:1872792636128768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786034424.430166:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034424.430235:0:8505:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a2d5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.430391:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636128768 00000100:00100000:3.0:1786034424.430403:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636128768 00000100:00100000:3.0:1786034424.430464:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1786034424.430475:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:8505:x1872792636128768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034424.430864:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:8505:x1872792636128768:12345-0@lo:502:llog_process_th.0 Request processed in 389us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.430880:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1786034424.430950:0:8505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8505:1872792636128768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034424.431041:0:8505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8505:1872792636128896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034424.431080:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034424.431101:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636128896 00000100:00100000:3.0:1786034424.431105:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636128896 00000100:00100000:3.0:1786034424.431125:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1786034424.431131:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:8505:x1872792636128896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034424.431245:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:8505:x1872792636128896:12345-0@lo:502:llog_process_th.0 Request processed in 113us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.431252:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1786034424.431282:0:8505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.431294:0:8505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8505:1872792636128896:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1786034424.431312:0:8505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1786034424.432083:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1786034424.432109:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786034424.432121:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034424.432140:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034424.432151:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1786034424.432154:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1786034424.432158:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1786034424.432190:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034424.432199:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034424.432209:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034424.432223:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636129024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786034424.432253:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034424.432269:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a2d5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.432641:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636129024 00000100:00100000:3.0:1786034424.432647:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636129024 00000100:00100000:3.0:1786034424.432682:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1786034424.432689:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:5858:x1872792636129024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034424.432702:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034424.432716:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964562313a00/0x490975051af3fc05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fbfe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.432752:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964562313a00/0x490975051af3fc05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fbfe expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.432776:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964562313a00/0x490975051af3fc05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fbfe expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.432786:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562313a00, rc 0) 00000100:00100000:3.0:1786034424.432843:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636129024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.432850:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1786034424.432884:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636129024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034424.432897:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.432906:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034424.432953:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636129152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034424.433566:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034424.433595:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cec9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1786034424.433609:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034424.433647:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636129152 00000100:00100000:1.0:1786034424.433652:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636129152 00000100:00100000:1.0:1786034424.433685:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1786034424.433692:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636129152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786034424.434044:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636129152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 351us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034424.434051:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1786034424.434133:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636129152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034424.434167:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636129280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034424.434204:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034424.434231:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cec9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034424.434268:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636129280 00000100:00100000:1.0:1786034424.434273:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636129280 00000100:00100000:1.0:1786034424.434303:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1786034424.434317:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636129280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786034424.434466:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636129280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034424.434473:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1786034424.438727:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636129280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034424.439050:0:8507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8507:1872792636129408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034424.439145:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034424.439185:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636129408 00000100:00100000:3.0:1786034424.439191:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636129408 00000100:00100000:3.0:1786034424.439234:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1786034424.439242:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:8507:x1872792636129408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034424.439477:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:8507:x1872792636129408:12345-0@lo:502:llog_process_th.0 Request processed in 235us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.439485:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1786034424.439535:0:8507:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558ceca80 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.439546:0:8507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8507:1872792636129408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786034424.439568:0:8507:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786034424.439578:0:8507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786034424.439581:0:8507:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1786034424.439586:0:8507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1786034424.439604:0:8507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8507:1872792636129536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034424.439630:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034424.439646:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636129536 00000100:00100000:3.0:1786034424.439650:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636129536 00000100:00100000:3.0:1786034424.439669:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1786034424.439675:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:8507:x1872792636129536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034424.439791:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:8507:x1872792636129536:12345-0@lo:502:llog_process_th.0 Request processed in 114us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.439798:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1786034424.439849:0:8507:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558ceca80 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.439861:0:8507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8507:1872792636129536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786034424.439880:0:8507:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786034424.439890:0:8507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786034424.439892:0:8507:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1786034424.439896:0:8507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1786034424.439951:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1786034424.439969:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1786034424.439980:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.439993:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034424.440005:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786034424.440008:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff964559843800 from 39 10000000:01000000:3.0:1786034424.440011:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786034424.440040:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.440049:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.440059:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034424.440070:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636129664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786034424.440095:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034424.440109:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558ceca80 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.440122:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636129664 00000100:00100000:3.0:1786034424.440126:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636129664 00000100:00100000:3.0:1786034424.440143:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1786034424.440148:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636129664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034424.440165:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034424.440178:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964562312600/0x490975051af3fc13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fc0c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.440200:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964562312600/0x490975051af3fc13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fc0c expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.440209:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964562312600/0x490975051af3fc13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fc0c expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.440218:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312600, rc 0) 00000100:00100000:3.0:1786034424.440242:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636129664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.440248:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1786034424.440272:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636129664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034424.440283:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.440292:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034424.440328:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636129792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034424.440347:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034424.440358:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558ceca80 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.440367:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636129792 00000100:00100000:3.0:1786034424.440370:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636129792 00000100:00100000:3.0:1786034424.440386:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1786034424.440392:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636129792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034424.461031:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636129792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 20624us (20667us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.461047:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1786034424.472198:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636129792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034424.472289:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636129920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034424.472385:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034424.472438:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf240 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.472641:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636129920 00000100:00100000:3.0:1786034424.472649:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636129920 00000100:00100000:3.0:1786034424.472718:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1786034424.472729:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636129920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034424.473010:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636129920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 282us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.473018:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1786034424.473383:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636129920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786034424.493219:0:8509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8509:1872792636130048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786034424.493318:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034424.493368:0:8509:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a2d5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034424.493870:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636130048 00000100:00100000:0.0:1786034424.493879:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636130048 00000100:00100000:0.0:1786034424.493937:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1786034424.493949:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:8509:x1872792636130048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034424.494308:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:8509:x1872792636130048:12345-0@lo:502:llog_process_th.0 Request processed in 360us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034424.494316:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1786034424.494382:0:8509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8509:1872792636130048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034424.494438:0:8509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8509:1872792636130176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034424.494474:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034424.494489:0:8509:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034424.495593:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636130176 00000100:00100000:0.0:1786034424.495606:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636130176 00000100:00100000:0.0:1786034424.495644:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1786034424.495652:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:8509:x1872792636130176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034424.495868:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:8509:x1872792636130176:12345-0@lo:502:llog_process_th.0 Request processed in 217us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034424.495875:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1786034424.495919:0:8509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8509:1872792636130176:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1786034424.495948:0:8509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1786034424.498100:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1786034424.498129:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786034424.498143:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034424.498156:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034424.498168:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1786034424.498171:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1786034424.498174:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1786034424.498213:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034424.498222:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034424.498234:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034424.498259:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636130304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786034424.498325:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034424.498362:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964549eb1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786034424.503671:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636130304 00000100:00100000:0.0:1786034424.503691:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636130304 00000100:00100000:0.0:1786034424.503784:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1786034424.503795:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636130304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786034424.503816:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034424.503855:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964582167600/0x490975051af3fc21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fc1a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034424.503891:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964582167600/0x490975051af3fc21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fc1a expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034424.503903:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964582167600/0x490975051af3fc21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fc1a expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034424.503913:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964582167600, rc 0) 00000100:00100000:0.0:1786034424.504073:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636130304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 279us (5746us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034424.504081:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1786034424.504148:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636130304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786034424.504186:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034424.504196:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034424.504277:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636130432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034424.504314:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034424.504334:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdff00 going to sleep for 11 seconds 00000100:00100000:0.0:1786034424.504350:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636130432 00000100:00100000:0.0:1786034424.504353:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636130432 00000100:00100000:0.0:1786034424.504373:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1786034424.504379:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636130432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034424.504719:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636130432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 339us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034424.504727:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1786034424.504764:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636130432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034424.504792:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636130560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034424.504852:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034424.504865:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdff00 going to sleep for 11 seconds 00000100:00100000:0.0:1786034424.504876:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636130560 00000100:00100000:0.0:1786034424.504879:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636130560 00000100:00100000:0.0:1786034424.504896:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1786034424.504902:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636130560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034424.506165:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636130560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1259us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034424.506184:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1786034424.506228:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636130560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034424.511755:0:8510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8510:1872792636130688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034424.511877:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034424.511931:0:8510:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454ad06000 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.512633:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636130688 00000100:00100000:3.0:1786034424.512642:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636130688 00000100:00100000:3.0:1786034424.512697:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1786034424.512708:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:8510:x1872792636130688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034424.513048:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:8510:x1872792636130688:12345-0@lo:502:llog_process_th.0 Request processed in 341us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.513057:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1786034424.513396:0:8510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8510:1872792636130688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786034424.513433:0:8510:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786034424.513443:0:8510:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034424.513446:0:8510:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1786034424.513453:0:8510:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1786034424.513479:0:8510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8510:1872792636130816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034424.513527:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034424.513550:0:8510:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454ad06000 going to sleep for 11 seconds 00000100:00100000:0.0:1786034424.513564:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636130816 00000100:00100000:0.0:1786034424.513568:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636130816 00000100:00100000:0.0:1786034424.513600:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1786034424.513608:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:8510:x1872792636130816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034424.513750:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:8510:x1872792636130816:12345-0@lo:502:llog_process_th.0 Request processed in 143us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034424.513758:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1786034424.513794:0:8510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8510:1872792636130816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786034424.513811:0:8510:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034424.513815:0:8510:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034424.513817:0:8510:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1786034424.513839:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1786034424.513900:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1786034424.513919:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1786034424.513931:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034424.513943:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034424.513960:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1786034424.513964:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff964542f499c0 from 1 10000000:01000000:0.0:1786034424.513967:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1786034424.513995:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fc28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034424.514005:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fc28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034424.514016:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fc28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034424.514029:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636130944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786034424.514058:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034424.514070:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454ad06000 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.514509:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636130944 00000100:00100000:3.0:1786034424.514513:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636130944 00000100:00100000:3.0:1786034424.514540:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1786034424.514547:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636130944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034424.514557:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034424.514571:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964562312000/0x490975051af3fc2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fc28 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.514595:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964562312000/0x490975051af3fc2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fc28 expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.514614:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964562312000/0x490975051af3fc2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fc28 expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.514623:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312000, rc 0) 00000100:00100000:3.0:1786034424.514656:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636130944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034424.514662:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1786034424.514694:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636130944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034424.514708:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fc28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc2f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.514718:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fc28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fc2f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034424.514779:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636131072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034424.514806:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034424.514848:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964559e370c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034424.514859:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636131072 00000100:00100000:3.0:1786034424.514862:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636131072 00000100:00100000:3.0:1786034424.514880:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1786034424.514887:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636131072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034424.515171:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636131072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (363us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786034424.515179:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1786034424.515208:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636131072:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1786034424.515241:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1786034424.515248:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fc28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc2f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034424.515255:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fc28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc2f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034425.462935:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786034425.470589:0:8547:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5326f510 20000000:00000080:0.0:1786034425.470604:0:8547:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96457e021c00 uarg=0000000000000000 20000000:01000000:1.0:1786034425.472693:0:8547:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1786034425.472700:0:8547:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1786034425.472704:0:8547:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1786034425.473357:0:8548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1786034425.473487:0:8547:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1786034425.481249:0:8547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1786034425.481304:0:8547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1786034425.481361:0:8547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1786034425.481379:0:8547:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1786034425.481396:0:8547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034425.481414:0:8547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964540030600/0x490975051af3f9ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3f9a4 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034425.481421:0:8547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964541652600/0x490975051af3fa0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fa06 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034425.481428:0:8547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9645413f0200/0x490975051af3fad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fad1 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034425.481437:0:8547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964574d01200/0x490975051af3fb95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75851d expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034425.481445:0:8547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034425.481485:0:8547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964574d01200/0x490975051af3fb95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75851d expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034425.481511:0:8547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964574d01200/0x490975051af3fb95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75851d expref: 9 pid: 5855 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034425.481526:0:8547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8547:1872792636131200:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034425.481632:0:8547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9645413f0200/0x490975051af3fad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fad1 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034425.481641:0:8547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9645413f0200/0x490975051af3fad8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fad1 expref: 18 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034425.481651:0:8547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8547:1872792636131328:0@lo:104: 00000100:00100000:1.0:1786034425.481689:0:8547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786034425.481739:0:8547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964541652600/0x490975051af3fa0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fa06 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034425.481748:0:8547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964541652600/0x490975051af3fa0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fa06 expref: 18 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034425.481756:0:8547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e071880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8547:1872792636131456:0@lo:104: 00000100:00100000:1.0:1786034425.481779:0:8547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786034425.481815:0:8547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964540030600/0x490975051af3f9ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3f9a4 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034425.481965:0:8547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964540030600/0x490975051af3f9ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3f9a4 expref: 18 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034425.481975:0:8547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e071c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8547:1872792636131584:0@lo:104: 00000100:00100000:1.0:1786034425.481998:0:8547:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542db1780 going to sleep for 11 seconds 00000100:00100000:0.0:1786034425.482219:0:5845:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786034425.482238:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034425.482250:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636131328 00000100:00100000:0.0:1786034425.482255:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636131328 00000100:00100000:0.0:1786034425.482385:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636131456 00000100:00100000:0.0:1786034425.482389:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636131456 00000100:00100000:0.0:1786034425.482408:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636131584 00000100:00100000:0.0:1786034425.482411:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636131584 00000100:00100000:0.0:1786034425.482424:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786034425.482432:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+5:8547:x1872792636131328:12345-0@lo:104: 00010000:00010000:0.0:1786034425.482444:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fad8 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.482502:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786034425.482508:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+5:8547:x1872792636131328:12345-0@lo:104: Request processed in 77us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034425.482514:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786034425.482529:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786034425.482535:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+4:8547:x1872792636131456:12345-0@lo:104: 00010000:00010000:0.0:1786034425.482543:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fa0d expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.482574:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1786034425.482579:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+4:8547:x1872792636131456:12345-0@lo:104: Request processed in 45us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034425.482586:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786034425.482615:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786034425.482631:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:8547:x1872792636131584:12345-0@lo:104: 00010000:00010000:0.0:1786034425.482638:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964541653800/0x490975051af3f9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f9ab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.482670:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1786034425.482674:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:8547:x1872792636131584:12345-0@lo:104: Request processed in 55us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034425.482688:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1786034425.482795:0:8547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8547:1872792636131328:0@lo:104: 00000100:00100000:1.0:1786034425.482804:0:8547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e071880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8547:1872792636131456:0@lo:104: 00000100:00100000:1.0:1786034425.482811:0:8547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e071c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8547:1872792636131584:0@lo:104: 00010000:00010000:0.0:1786034425.482891:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786034425.482897:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fad8 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.482905:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964541652400 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034425.482909:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fad8 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.482917:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fad8 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034425.482923:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fad8 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034425.482929:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786034425.482963:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fad8 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.482970:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034425.482990:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fad8 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.482997:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964541652400/0x490975051af3fad1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fad8 expref: -99 pid: 7664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.483008:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786034425.483011:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fa0d expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.483026:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312800 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034425.483029:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fa0d expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.483036:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fa0d expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034425.483042:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fa0d expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034425.483047:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786034425.483061:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa0d expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.483067:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034425.483073:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa0d expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.483078:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964562312800/0x490975051af3fa06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fa0d expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.483087:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034425.483090:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964541653800/0x490975051af3f9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3f9ab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.483097:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964541653800 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034425.483100:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964541653800/0x490975051af3f9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3f9ab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.483116:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964541653800/0x490975051af3f9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3f9ab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034425.483122:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964541653800/0x490975051af3f9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3f9ab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034425.483128:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786034425.483141:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964541653800/0x490975051af3f9a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f9ab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.483147:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034425.483172:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964541653800/0x490975051af3f9a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f9ab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.483179:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964541653800/0x490975051af3f9a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3f9ab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034425.483191:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034425.483193:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034425.483195:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034425.483201:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034425.483212:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636131712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034425.483489:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636131840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786034425.483543:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636131968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034425.486344:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034425.487350:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034425.487423:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636131840 00000100:00100000:2.0:1786034425.487430:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636131840 00010000:00010000:2.0:1786034425.487465:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964541652600/0x490975051af3fa0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fa06 expref: 19 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034425.487488:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636131968 00000100:00100000:2.0:1786034425.487490:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636131968 00010000:00010000:2.0:1786034425.487518:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964540030600/0x490975051af3f9ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f9a4 expref: 20 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034425.487541:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786034425.487548:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+20:3308:x1872792636131840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786034425.487561:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034425.487567:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964541652600/0x490975051af3fa0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fa06 expref: 20 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.487578:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964541652600/0x490975051af3fa0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fa06 expref: 20 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.487594:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964541652600/0x490975051af3fa0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fa06 expref: 20 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.487619:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034425.487659:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636131840:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034425.487667:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786034425.487680:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786034425.487686:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:3309:x1872792636131968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786034425.487692:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034425.487697:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964540030600/0x490975051af3f9ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3f9a4 expref: 18 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.487705:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964540030600/0x490975051af3f9ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3f9a4 expref: 18 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.487715:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964540030600/0x490975051af3f9ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3f9a4 expref: 18 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.487745:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034425.487770:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:3309:x1872792636131968:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034425.487776:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786034425.487811:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636131840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786034425.487848:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636131968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786034425.491139:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034425.491229:0:8547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8547:1872792636131200:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034425.491262:0:8547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034425.491316:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034425.494307:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636131712 00000100:00100000:2.0:1786034425.494319:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636131712 00010000:00010000:0.0:1786034425.495913:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9645413f0200/0x490975051af3fad8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fad1 expref: 17 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034425.496474:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034425.507707:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608839424 00000100:00100000:0.0:1786034425.507720:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608839424 00010000:00010000:0.0:1786034425.507773:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964574d01200/0x490975051af3fb95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75851d expref: 10 pid: 5855 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034425.509811:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786034425.509849:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:3307:x1872792636131712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786034425.509868:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034425.509877:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9645413f0200/0x490975051af3fad8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fad1 expref: 17 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.509890:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9645413f0200/0x490975051af3fad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fad1 expref: 17 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.509908:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f0200/0x490975051af3fad8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fad1 expref: 17 pid: 5855 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.509924:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034425.510003:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3307:x1872792636131712:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (18687us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034425.510011:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786034425.510032:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 24 00000100:00100000:2.0:1786034425.510040:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2363:x1872792608839424:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034425.510058:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034425.510063:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964574d01200/0x490975051af3fb95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75851d expref: 10 pid: 5855 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.510073:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964574d01200/0x490975051af3fb95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75851d expref: 10 pid: 5855 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.510083:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964574d01200/0x490975051af3fb95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75851d expref: 10 pid: 5855 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.510093:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.510101:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034425.510102:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636131712:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786034425.510116:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.510123:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.510128:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.510135:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.510142:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01a00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:2.0:1786034425.510145:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.510164:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.510720:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034425.510742:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034425.510783:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:2363:x1872792608839424:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 744us (14311us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034425.510791:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 24 00010000:00010000:3.0:1786034425.510937:0:8547:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034425.510951:0:8547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034425.510957:0:8547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964574d01a00/0x490975051af3fc36 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034425.712247:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034425.712295:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034425.712326:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034425.712352:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608839552 00000100:00100000:3.0:1786034425.712361:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608839552 00000100:00100000:3.0:1786034425.712433:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 36 00000100:00100000:3.0:1786034425.712444:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608839552:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034425.712515:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608839552:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 73us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034425.712534:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 36 00000100:00100000:3.0:1786034425.712560:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608839680 00000100:00100000:3.0:1786034425.712564:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608839680 00000100:00100000:3.0:1786034425.712588:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608839808 00000100:00100000:3.0:1786034425.712591:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608839808 00000100:00100000:3.0:1786034425.712607:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:3.0:1786034425.712613:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2363:x1872792608839680:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034425.712640:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2363:x1872792608839680:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034425.712646:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:3.0:1786034425.712658:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 17 00000100:00100000:3.0:1786034425.712664:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2363:x1872792608839808:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034425.712685:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2363:x1872792608839808:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 22us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034425.712691:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 17 00000100:00080000:3.0:1786034425.712708:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786034425.712712:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786034425.712714:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034426.417855:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034426.417877:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636132096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034426.417952:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034426.418020:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636132096 00000100:00100000:3.0:1786034426.418027:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636132096 00000100:00100000:3.0:1786034426.418078:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786034426.418087:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636132096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786034426.418119:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034426.418314:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636132096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 227us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034426.418321:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1786034426.421394:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1786034426.421464:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9645747b4a80 x1872792636132096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034426.421487:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636132096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034426.428130:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636132352:0@lo:400:kworker.0 00000100:00100000:3.0:1786034426.428239:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636132224:0@lo:400:kworker.0 00000100:00100000:3.0:1786034426.428300:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034426.428315:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636132480:0@lo:400:kworker.0 00000100:00100000:3.0:1786034426.428336:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636132736:0@lo:400:kworker.0 00000100:00100000:1.0:1786034426.428344:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034426.428362:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636132224 00000100:00100000:3.0:1786034426.428369:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636132224 00000100:00100000:1.0:1786034426.428373:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786034426.428378:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636132608:0@lo:400:kworker.0 00000100:00100000:3.0:1786034426.428409:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1786034426.428418:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3307:x1872792636132224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034426.428461:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3307:x1872792636132224:12345-0@lo:400:kworker.0 Request processed in 44us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034426.428466:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034426.428468:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1786034426.428493:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636132480 00000100:00100000:3.0:1786034426.428495:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034426.428497:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636132480 00000100:00100000:3.0:1786034426.428526:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636132224:0@lo:400:kworker.0 00000100:00100000:1.0:1786034426.428527:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636132736 00000100:00100000:1.0:1786034426.428530:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636132736 00000100:00100000:1.0:1786034426.428549:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1786034426.428550:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636132608 00000100:00100000:3.0:1786034426.428552:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636132608 00000100:00100000:1.0:1786034426.428554:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636132480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034426.428575:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786034426.428581:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636132608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034426.428587:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636132480:12345-0@lo:400:kworker.0 Request processed in 33us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034426.428603:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786034426.428670:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786034426.428677:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636132736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034426.428681:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636132608:12345-0@lo:400:kworker.0 Request processed in 101us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034426.428688:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786034426.428708:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636132736:12345-0@lo:400:kworker.0 Request processed in 32us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034426.428714:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1786034426.428733:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636132736:0@lo:400:kworker.0 00000100:00080000:1.0:1786034426.428740:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034426.428745:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786034426.428763:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964542e26300 x1872792636132608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034426.428773:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636132608:0@lo:400:kworker.0 00000100:00100000:1.0:1786034426.428783:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636132480:0@lo:400:kworker.0 00000100:00100000:0.0:1786034426.428806:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034426.428922:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636132352 00000100:00100000:3.0:1786034426.428926:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636132352 00000100:00100000:3.0:1786034426.429021:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1786034426.429035:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636132352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034426.429078:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636132352:12345-0@lo:400:kworker.0 Request processed in 44us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034426.429084:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1786034426.432743:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636132352:0@lo:400:kworker.0 00010000:00010000:0.0:1786034426.487367:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1786034426.674307:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786034426.674315:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96457642c000 from 4 10000000:01000000:1.0:1786034426.674319:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786034426.674373:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034426.674386:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034426.674397:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034426.674427:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e071880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636132864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786034426.674502:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034426.674553:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542db1840 going to sleep for 11 seconds 00000100:00100000:0.0:1786034426.674774:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636132864 00000100:00100000:0.0:1786034426.674782:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636132864 00000100:00100000:0.0:1786034426.674855:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1786034426.674863:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636132864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786034426.674875:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034426.674888:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964582167200/0x490975051af3fc44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fc3d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034426.674909:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964582167200/0x490975051af3fc44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fc3d expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034426.674919:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964582167200/0x490975051af3fc44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fc3d expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034426.674928:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964582167200, rc 0) 00000100:00100000:0.0:1786034426.674973:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636132864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034426.674980:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1786034426.675134:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e071880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636132864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786034426.675147:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc44 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034426.675156:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fc44 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034426.675211:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636132992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034426.675234:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034426.675266:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645595b7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034426.676023:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636132992 00000100:00100000:0.0:1786034426.676028:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636132992 00000100:00100000:0.0:1786034426.676061:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1786034426.676068:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636132992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034426.676340:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636132992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034426.676354:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1786034426.676390:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636132992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034426.676431:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636133120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034426.676464:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034426.676482:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786034426.676492:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636133120 00000100:00100000:0.0:1786034426.676495:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636133120 00000100:00100000:0.0:1786034426.676509:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1786034426.676514:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636133120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034426.676864:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636133120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 349us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034426.676871:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1786034426.676901:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636133120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034426.677055:0:8568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8568:1872792636133248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034426.677083:0:8568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034426.677098:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636133248 00000100:00100000:0.0:1786034426.677101:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636133248 00000100:00100000:0.0:1786034426.677115:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1786034426.677120:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:8568:x1872792636133248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786034426.677344:0:8568:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034426.677951:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:8568:x1872792636133248:12345-0@lo:502:llog_process_th.0 Request processed in 829us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034426.677958:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1786034426.685749:0:8568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8568:1872792636133248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786034426.685796:0:8568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786034426.685808:0:8568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034426.685811:0:8568:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1786034426.685820:0:8568:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96457642c000 00000020:00000080:0.0:1786034426.685866:0:8568:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1786034426.685968:0:8568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8568:1872792636133376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034426.686031:0:8568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034426.686062:0:8568:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034426.686184:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636133376 00000100:00100000:1.0:1786034426.686191:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636133376 00000100:00100000:1.0:1786034426.686238:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1786034426.686247:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:8568:x1872792636133376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786034426.686451:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:8568:x1872792636133376:12345-0@lo:502:llog_process_th.0 Request processed in 204us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034426.686459:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1786034426.686632:0:8568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8568:1872792636133376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786034426.686651:0:8568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786034426.686656:0:8568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786034426.686657:0:8568:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1786034426.686662:0:8568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1786034426.686915:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1786034426.686932:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786034426.686949:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc44 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034426.686959:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc44 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034426.686967:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786034426.686969:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff964548917000 from 4 10000000:01000000:1.0:1786034426.686971:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786034426.686992:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034426.686999:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034426.687016:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034426.687028:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636133504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786034426.687052:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034426.687078:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542db1480 going to sleep for 11 seconds 00000100:00100000:3.0:1786034426.687169:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636133504 00000100:00100000:3.0:1786034426.687173:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636133504 00000100:00100000:3.0:1786034426.687201:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1786034426.687207:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636133504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034426.687216:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034426.687227:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964562312200/0x490975051af3fc52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fc4b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034426.687244:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964562312200/0x490975051af3fc52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fc4b expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034426.687253:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964562312200/0x490975051af3fc52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fc4b expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034426.687260:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312200, rc 0) 00000100:00100000:3.0:1786034426.687290:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636133504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034426.687295:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1786034426.687320:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636133504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034426.687336:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc52 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034426.687344:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fc52 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034426.687381:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636133632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034426.687401:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034426.687427:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1786034426.687437:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636133632 00000100:00100000:3.0:1786034426.687440:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636133632 00000100:00100000:3.0:1786034426.687454:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1786034426.687459:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636133632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034426.687751:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636133632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034426.687757:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1786034426.687782:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636133632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034426.687804:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636133760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034426.687850:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034426.687865:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1786034426.687875:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636133760 00000100:00100000:3.0:1786034426.687878:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636133760 00000100:00100000:3.0:1786034426.687892:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1786034426.687898:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636133760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034426.688282:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636133760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 384us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034426.688296:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1786034426.688326:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636133760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034426.689073:0:8569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8569:1872792636133888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034426.689110:0:8569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034426.689130:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636133888 00000100:00100000:3.0:1786034426.689133:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636133888 00000100:00100000:3.0:1786034426.689152:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1786034426.689210:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:8569:x1872792636133888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034426.689328:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:8569:x1872792636133888:12345-0@lo:502:llog_process_th.0 Request processed in 169us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034426.689336:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1786034426.689370:0:8569:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034426.689383:0:8569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8569:1872792636133888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786034426.689401:0:8569:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786034426.689408:0:8569:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786034426.691023:0:8569:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1786034426.691033:0:8569:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff964548917000 00000020:00000080:3.0:1786034426.691036:0:8569:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1786034426.691092:0:8569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8569:1872792636134016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034426.691131:0:8569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034426.691151:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636134016 00000100:00100000:3.0:1786034426.691156:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636134016 00000100:00100000:3.0:1786034426.693536:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1786034426.693544:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:8569:x1872792636134016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034426.695208:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:8569:x1872792636134016:12345-0@lo:502:llog_process_th.0 Request processed in 1658us (4072us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034426.695224:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1786034426.695280:0:8569:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034426.695302:0:8569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8569:1872792636134016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786034426.695334:0:8569:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786034426.695342:0:8569:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786034426.695344:0:8569:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1786034426.695349:0:8569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1786034426.714897:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1786034426.714931:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786034426.714951:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc52 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034426.714964:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc52 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034426.714973:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786034426.714976:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff964559843800 from 4 10000000:01000000:1.0:1786034426.714979:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786034426.715010:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034426.715018:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034426.715028:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034426.715050:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636134144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786034426.715105:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034426.715165:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542db1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034426.715295:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636134144 00000100:00100000:2.0:1786034426.715302:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636134144 00000100:00100000:2.0:1786034426.715350:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1786034426.715359:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636134144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786034426.715371:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034426.715383:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9645413f0800/0x490975051af3fc60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fc59 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034426.719595:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f0800/0x490975051af3fc60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fc59 expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034426.719609:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9645413f0800/0x490975051af3fc60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fc59 expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034426.719627:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0800, rc 0) 00000100:00100000:2.0:1786034426.719701:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636134144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4342us (4594us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034426.719709:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1786034426.721096:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636134144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786034426.721117:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc60 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034426.721127:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fc60 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034426.721208:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636134272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786034426.721247:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034426.721283:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542db1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034426.733295:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636134272 00000100:00100000:2.0:1786034426.733308:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636134272 00000100:00100000:2.0:1786034426.733369:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1786034426.733377:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636134272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034426.733688:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636134272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (12439us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034426.733696:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1786034426.733762:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636134272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034426.733812:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636134400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786034426.733872:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034426.733901:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964580905d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786034426.733917:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636134400 00000100:00100000:2.0:1786034426.733920:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636134400 00000100:00100000:2.0:1786034426.733953:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1786034426.733959:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636134400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786034426.734086:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636134400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034426.734093:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1786034426.734123:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636134400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786034426.734314:0:8571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a12680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8571:1872792636134528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786034426.734344:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034426.734359:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636134528 00000100:00100000:2.0:1786034426.734362:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636134528 00000100:00100000:2.0:1786034426.734379:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1786034426.734385:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:8571:x1872792636134528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786034426.734484:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:8571:x1872792636134528:12345-0@lo:502:llog_process_th.0 Request processed in 98us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034426.734490:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1786034426.734513:0:8571:0:(client.c:2702:ptlrpc_set_wait()) set ffff964580905d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786034426.734523:0:8571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a12680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8571:1872792636134528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786034426.734540:0:8571:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786034426.734548:0:8571:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034426.734551:0:8571:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1786034426.734556:0:8571:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff964559843800 00000020:00000080:2.0:1786034426.734558:0:8571:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786034426.734887:0:8571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a12680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8571:1872792636134656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786034426.734920:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034426.734936:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636134656 00000100:00100000:2.0:1786034426.734939:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636134656 00000100:00100000:2.0:1786034426.734956:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1786034426.734961:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:8571:x1872792636134656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786034426.735055:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:8571:x1872792636134656:12345-0@lo:502:llog_process_th.0 Request processed in 93us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034426.735061:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1786034426.735086:0:8571:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c751f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786034426.735096:0:8571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a12680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:8571:1872792636134656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786034426.735110:0:8571:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786034426.735114:0:8571:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034426.735116:0:8571:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1786034426.735119:0:8571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1786034426.735162:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1786034426.735178:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786034426.735187:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc60 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034426.735197:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc60 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034427.293023:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034427.293126:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608839936 00000100:00100000:2.0:1786034427.293135:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608839936 00000100:00100000:2.0:1786034427.293194:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 190 00000100:00100000:2.0:1786034427.293204:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:5613:x1872792608839936:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786034427.293220:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034427.293237:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9645413f1c00/0x490975051af3fc67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75855c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034427.293262:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f1c00/0x490975051af3fc67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75855c expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034427.293289:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9645413f1c00/0x490975051af3fc67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75855c expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034427.293298:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f1c00, rc 0) 00000100:00100000:2.0:1786034427.293351:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5613:x1872792608839936:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 Request processed in 149us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034427.293357:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 190 00000100:00100000:3.0:1786034427.301529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034427.301666:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608840064 00000100:00100000:2.0:1786034427.301676:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608840064 00000100:00100000:2.0:1786034427.301745:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 191 00000100:00100000:2.0:1786034427.301754:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5613:x1872792608840064:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034427.302086:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5613:x1872792608840064:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 Request processed in 331us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034427.302094:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 191 00000100:00100000:3.0:1786034427.306041:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034427.306164:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608840192 00000100:00100000:0.0:1786034427.306173:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608840192 00000100:00100000:0.0:1786034427.306219:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 192 00000100:00100000:0.0:1786034427.306228:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5613:x1872792608840192:12345-192.168.203.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034427.306436:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:5613:x1872792608840192:12345-192.168.203.56@tcp:503:ll_cfg_requeue.0 Request processed in 208us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034427.306444:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 192 00000100:00100000:3.0:1786034427.309475:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034427.309656:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608840320 00000100:00100000:0.0:1786034427.309666:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608840320 00000100:00100000:0.0:1786034427.309726:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 193 00000100:00100000:0.0:1786034427.309735:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:6138:x1872792608840320:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786034427.319633:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:6138:x1872792608840320:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 9888us (10155us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034427.319647:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 193 00000100:00100000:3.0:1786034427.326892:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034427.328701:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608840448 00000100:00100000:2.0:1786034427.328723:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608840448 00000100:00100000:2.0:1786034427.328775:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 194 00000100:00100000:2.0:1786034427.328785:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:6138:x1872792608840448:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786034427.330896:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:6138:x1872792608840448:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 2106us (4006us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034427.330908:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 194 00010000:00010000:1.0:1786034427.504926:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034428.530687:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034429.488786:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786034429.488806:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636134784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034429.488885:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034429.489014:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636134784 00000100:00100000:3.0:1786034429.489021:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636134784 00000100:00100000:3.0:1786034429.489083:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1786034429.489092:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636134784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786034429.489122:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034429.489165:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636134784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034429.489173:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1786034429.489232:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786034429.489259:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9645747b6a00 x1872792636134784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034429.489276:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636134784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786034429.552071:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034430.576993:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034430.820818:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034430.820998:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034430.821030:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034430.821061:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034430.821110:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608840704 00000100:00100000:3.0:1786034430.821133:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608840704 00000100:00100000:3.0:1786034430.821212:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 40 00000100:00100000:3.0:1786034430.821224:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2365:x1872792608840704:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034430.821366:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608840576 00000100:00100000:0.0:1786034430.821370:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608840576 00000100:00100000:0.0:1786034430.821415:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 195 00000100:00100000:0.0:1786034430.821423:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2365:x1872792608840576:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034430.821525:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608840832 00000100:00100000:2.0:1786034430.821530:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608840832 00000100:00100000:2.0:1786034430.821562:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608840960 00000100:00100000:2.0:1786034430.821565:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608840960 00000100:00100000:2.0:1786034430.821583:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 19 00000100:00100000:2.0:1786034430.821590:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2365:x1872792608840832:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034430.821660:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2365:x1872792608840704:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 438us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034430.821669:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 40 00000100:00100000:3.0:1786034430.821704:0:6719:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1786034430.821713:0:6719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1786034430.833505:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2365:x1872792608840576:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 12066us (12684us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034430.833524:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 195 00000100:00100000:2.0:1786034430.834891:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2365:x1872792608840832:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 13296us (13887us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034430.834903:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 19 00000100:00100000:2.0:1786034430.834943:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00100000:2.0:1786034430.834957:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2365:x1872792608840960:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034430.835010:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2365:x1872792608840960:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 59us (13949us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034430.835015:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00080000:2.0:1786034430.835043:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786034430.835049:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786034430.835053:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034431.541137:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786034431.541165:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636134912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034431.541252:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034431.541332:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636134912 00000100:00100000:2.0:1786034431.541340:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636134912 00000100:00100000:2.0:1786034431.541408:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786034431.541439:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636134912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034431.541483:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034431.541531:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636134912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034431.541538:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1786034431.541560:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1786034431.541590:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964548a11c00 x1872792636134912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034431.541610:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636134912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034431.545112:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636135424:0@lo:400:kworker.0 00000100:00100000:3.0:1786034431.545196:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034431.545246:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786034431.545253:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636135040:0@lo:400:kworker.0 00000100:00100000:3.0:1786034431.545284:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034431.545306:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636135552:0@lo:400:kworker.0 00000100:00100000:3.0:1786034431.545332:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034431.545358:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636135168:0@lo:400:kworker.0 00000100:00100000:3.0:1786034431.545380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034431.545396:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786034431.545401:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636135296:0@lo:400:kworker.0 00000100:00100000:3.0:1786034431.545423:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034431.545453:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636135424 00000100:00100000:3.0:1786034431.545460:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636135424 00000100:00100000:3.0:1786034431.545517:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786034431.545526:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636135424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034431.545575:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636135424:12345-0@lo:400:kworker.0 Request processed in 50us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034431.545591:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786034431.545615:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636135040 00000100:00100000:3.0:1786034431.545618:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636135040 00000100:00100000:3.0:1786034431.545645:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1786034431.545651:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636135040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034431.545694:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636135040:12345-0@lo:400:kworker.0 Request processed in 31us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034431.545701:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1786034431.545728:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636135552 00000100:00100000:3.0:1786034431.545732:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636135552 00000100:00100000:3.0:1786034431.545756:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636135168 00000100:00100000:3.0:1786034431.545758:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636135168 00000100:00100000:3.0:1786034431.545771:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636135296 00000100:00100000:3.0:1786034431.545773:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636135296 00000100:00100000:3.0:1786034431.545787:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786034431.545793:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454767b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636135552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034431.545844:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454767b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636135552:12345-0@lo:400:kworker.0 Request processed in 29us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034431.545851:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786034431.545863:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786034431.545869:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636135168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034431.545900:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636135168:12345-0@lo:400:kworker.0 Request processed in 32us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034431.545906:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786034431.545915:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1786034431.545921:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636135296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034431.545958:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636135296:12345-0@lo:400:kworker.0 Request processed in 37us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034431.545964:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1786034431.545986:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786034431.545992:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786034431.546020:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636135040:0@lo:400:kworker.0 00000100:00100000:3.0:1786034431.546030:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636135552:0@lo:400:kworker.0 00010000:00080000:3.0:1786034431.546040:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9645747b6a00 x1872792636135424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034431.546049:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636135424:0@lo:400:kworker.0 00000100:00100000:3.0:1786034431.546081:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636135296:0@lo:400:kworker.0 00000100:00100000:3.0:1786034431.546092:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636135168:0@lo:400:kworker.0 00010000:00010000:3.0:1786034431.600032:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034432.625351:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034433.649573:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034434.613326:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96454767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636135680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786034434.613412:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034434.615352:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636135680 00000100:00100000:2.0:1786034434.615364:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636135680 00000100:00100000:2.0:1786034434.615438:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786034434.615448:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636135680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786034434.615488:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034434.615556:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636135680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (2144us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034434.615563:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1786034434.615605:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96454767a300 x1872792636135680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034434.615624:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96454767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636135680:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786034434.619424:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786034434.684728:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034435.704058:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034435.948782:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034435.948851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034435.948889:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608841216 00000100:00100000:3.0:1786034435.948899:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608841216 00000100:00100000:2.0:1786034435.948954:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034435.948969:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 44 00000100:00100000:2.0:1786034435.948977:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608841344 00000100:00100000:3.0:1786034435.948980:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608841216:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034435.948987:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608841344 00000100:00100000:2.0:1786034435.949018:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:2.0:1786034435.949024:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2361:x1872792608841344:12345-192.168.203.56@tcp:9:kworker.0 00000020:00000080:2.0:1786034435.949053:0:6719:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fba3 00000100:00080000:2.0:1786034435.949064:0:6719:0:(import.c:65:import_set_state_nolock()) ffff964445078000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1786034435.949066:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608841216:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 88us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034435.949073:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 44 00000001:00000004:2.0:1786034435.949107:0:6719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1786034435.949340:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034435.949347:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034435.949640:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608841088 00000100:00100000:0.0:1786034435.949656:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608841088 00000100:00100000:0.0:1786034435.949702:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 197 00000100:00100000:0.0:1786034435.949709:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2363:x1872792608841088:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034435.950163:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2363:x1872792608841088:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 453us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034435.950172:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 197 00010000:00010000:0.0:1786034435.950209:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034435.958025:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+2:2361:x1872792608841344:12345-192.168.203.56@tcp:9:kworker.0 Request processed in 8987us (9056us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034435.958041:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:0.0:1786034435.958324:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034435.963781:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608841472 00000100:00100000:3.0:1786034435.963796:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608841472 00000100:00100000:3.0:1786034435.964144:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00100000:3.0:1786034435.964155:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2361:x1872792608841472:12345-192.168.203.56@tcp:9:kworker.0 00000020:00000080:3.0:1786034435.964196:0:6721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fbaa 00000100:00080000:3.0:1786034435.964207:0:6721:0:(import.c:65:import_set_state_nolock()) ffff9644458f6000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1786034435.964261:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1786034435.964296:0:6721:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1786034435.964936:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786034435.966043:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+2:2361:x1872792608841472:12345-192.168.203.56@tcp:9:kworker.0 Request processed in 1885us (7715us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034435.966053:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 11 00000001:02000400:3.0:1786034436.014982:0:8848:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg356-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1786034436.658310:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636136192:0@lo:400:kworker.0 00000100:00100000:0.0:1786034436.658394:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034436.658479:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786034436.658486:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636135808:0@lo:400:kworker.0 00000100:00100000:0.0:1786034436.658520:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034436.658542:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636136320:0@lo:400:kworker.0 00000100:00100000:1.0:1786034436.658545:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636135808 00000100:00100000:1.0:1786034436.658554:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636135808 00000100:00100000:0.0:1786034436.658568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034436.658594:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636135936:0@lo:400:kworker.0 00000100:00100000:1.0:1786034436.658610:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1786034436.658618:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034436.658619:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636135808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034436.658634:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636136448:0@lo:400:kworker.0 00000100:00100000:1.0:1786034436.658685:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636135808:12345-0@lo:400:kworker.0 Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034436.658685:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034436.658693:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1786034436.658704:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034436.658708:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636136064:0@lo:400:kworker.0 00000100:00100000:0.0:1786034436.658739:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034436.660607:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636136192 00000100:00100000:0.0:1786034436.660617:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636136192 00000100:00100000:0.0:1786034436.660692:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636136448 00000100:00100000:0.0:1786034436.660694:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636136448 00000100:00100000:0.0:1786034436.660720:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786034436.660727:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636136192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034436.661087:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636136320 00000100:00100000:1.0:1786034436.661092:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636136320 00000100:00100000:1.0:1786034436.661119:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636135936 00000100:00100000:1.0:1786034436.661122:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636135936 00000100:00100000:1.0:1786034436.661132:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636136064 00000100:00100000:1.0:1786034436.661144:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636136064 00000100:00100000:1.0:1786034436.661160:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1786034436.661166:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636136320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034436.661208:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636136320:12345-0@lo:400:kworker.0 Request processed in 42us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034436.661215:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1786034436.661228:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1786034436.661328:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636135936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034436.661408:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636135936:12345-0@lo:400:kworker.0 Request processed in 175us (2789us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034436.661414:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1786034436.661426:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786034436.661432:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636136064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034436.661456:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636136064:12345-0@lo:400:kworker.0 Request processed in 25us (2717us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034436.661461:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1786034436.661906:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636136192:12345-0@lo:400:kworker.0 Request processed in 1178us (3511us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034436.661914:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786034436.661982:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786034436.661990:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636136448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034436.662022:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636136448:12345-0@lo:400:kworker.0 Request processed in 34us (3337us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034436.662027:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1786034436.662054:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786034436.662059:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786034436.662062:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786034436.662081:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636136576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034436.662113:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034436.662168:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636136064:0@lo:400:kworker.0 00000100:00100000:0.0:1786034436.662179:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636135936:0@lo:400:kworker.0 00010000:00080000:0.0:1786034436.662190:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964542e25180 x1872792636136448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034436.662201:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636136448:0@lo:400:kworker.0 00000100:00100000:0.0:1786034436.662243:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636135808:0@lo:400:kworker.0 00000100:00100000:0.0:1786034436.662255:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636136320:0@lo:400:kworker.0 00010000:00080000:0.0:1786034436.662266:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964542e25880 x1872792636136192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034436.662276:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636136192:0@lo:400:kworker.0 00000100:00100000:2.0:1786034436.662305:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636136576 00000100:00100000:2.0:1786034436.662311:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636136576 00000100:00100000:2.0:1786034436.662404:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786034436.662413:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636136576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034436.662446:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034436.662491:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636136576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034436.662498:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1786034436.663503:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964548a13800 x1872792636136576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034436.663519:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636136576:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786034436.721208:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034437.754608:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034438.769123:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786034439.317211:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 696d4f9b-62ce-40a0-a754-08fa96a026cd 00000020:00000080:0.0:1786034439.317220:0:7682:0:(genops.c:906:class_export_put()) final put ffff9644458f2000/696d4f9b-62ce-40a0-a754-08fa96a026cd 00000020:00000080:3.0:1786034439.317338:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9644458f2000/696d4f9b-62ce-40a0-a754-08fa96a026cd for lustre-OST0001 00000020:00000080:3.0:1786034439.317389:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9644458f6000 for lustre-OST0001 00000100:00100000:1.0:1786034439.728699:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786034439.728728:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636136704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034439.728802:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034439.729246:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636136704 00000100:00100000:0.0:1786034439.729254:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636136704 00000100:00100000:0.0:1786034439.729310:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786034439.729319:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636136704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034439.729353:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034439.729407:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636136704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034439.729414:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1786034439.729818:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786034439.729859:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551935880 x1872792636136704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034439.729876:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636136704:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786034439.795520:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786034440.325990:0:6746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 696d4f9b-62ce-40a0-a754-08fa96a026cd 00000020:00000080:0.0:1786034440.325998:0:6746:0:(genops.c:906:class_export_put()) final put ffff96444507b000/696d4f9b-62ce-40a0-a754-08fa96a026cd 00000020:00000080:3.0:1786034440.326045:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96444507b000/696d4f9b-62ce-40a0-a754-08fa96a026cd for lustre-OST0000 00000020:00000080:3.0:1786034440.326087:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff964445078000 for lustre-OST0000 00010000:00010000:0.0:1786034440.820400:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034441.054943:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034441.054995:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034441.055023:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608841600 00000100:00100000:3.0:1786034441.055030:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608841600 00000100:00100000:3.0:1786034441.055073:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 199 00000100:00100000:3.0:1786034441.055081:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608841600:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034441.055139:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608841600:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 59us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034441.055146:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 199 00000100:00100000:0.0:1786034441.055297:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608841728 00000100:00100000:0.0:1786034441.055302:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608841728 00000100:00100000:0.0:1786034441.055346:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 48 00000100:00100000:0.0:1786034441.055360:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454767a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608841728:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034441.055393:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454767a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608841728:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 35us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034441.055399:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 48 00000100:00080000:3.0:1786034441.055615:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034441.779799:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786034441.779835:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636136832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034441.779902:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034441.779982:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636136832 00000100:00100000:0.0:1786034441.779989:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636136832 00000100:00100000:0.0:1786034441.780040:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786034441.780049:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636136832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786034441.780083:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034441.780126:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636136832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034441.780133:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1786034441.780153:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1786034441.780181:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551934380 x1872792636136832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034441.780199:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636136832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034441.781698:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636137088:0@lo:400:kworker.0 00000100:00100000:3.0:1786034441.781752:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034441.781784:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786034441.781789:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636136960:0@lo:400:kworker.0 00000100:00100000:3.0:1786034441.781818:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034441.781876:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636137472:0@lo:400:kworker.0 00000100:00100000:3.0:1786034441.781897:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034441.781924:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636136960 00000100:00100000:3.0:1786034441.781929:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636136960 00000100:00100000:3.0:1786034441.781962:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1786034441.781969:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636136960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034441.782010:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636136960:12345-0@lo:400:kworker.0 Request processed in 41us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034441.782017:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1786034441.782048:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636137344:0@lo:400:kworker.0 00000100:00100000:3.0:1786034441.782074:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034441.782091:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786034441.782096:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636137216:0@lo:400:kworker.0 00000100:00100000:3.0:1786034441.782116:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034441.782146:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636136960:0@lo:400:kworker.0 00000100:00100000:1.0:1786034441.782395:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636137088 00000100:00100000:1.0:1786034441.782400:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636137088 00000100:00100000:1.0:1786034441.782448:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636137472 00000100:00100000:1.0:1786034441.782451:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636137472 00000100:00100000:1.0:1786034441.782469:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636137216 00000100:00100000:1.0:1786034441.782472:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636137216 00000100:00100000:1.0:1786034441.782485:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786034441.782491:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636137088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034441.782528:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636137088:12345-0@lo:400:kworker.0 Request processed in 37us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034441.782534:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786034441.782546:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1786034441.782552:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636137472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034441.782574:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636137472:12345-0@lo:400:kworker.0 Request processed in 24us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034441.782579:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1786034441.782588:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1786034441.782593:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454767b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636137216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034441.782625:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454767b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636137216:12345-0@lo:400:kworker.0 Request processed in 31us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034441.782631:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786034441.782811:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636137344 00000100:00100000:0.0:1786034441.782815:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636137344 00000100:00100000:0.0:1786034441.782984:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786034441.782990:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454767bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636137344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034441.783031:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454767bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636137344:12345-0@lo:400:kworker.0 Request processed in 41us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034441.783036:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1786034441.783071:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786034441.783075:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034441.784979:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636137216:0@lo:400:kworker.0 00010000:00080000:3.0:1786034441.784997:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457e070380 x1872792636137344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034441.785009:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636137344:0@lo:400:kworker.0 00000100:00100000:3.0:1786034441.785061:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636137472:0@lo:400:kworker.0 00000100:00100000:3.0:1786034441.785073:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636137088:0@lo:400:kworker.0 00010000:00010000:1.0:1786034441.840998:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786034442.664673:0:9094:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg356-server.virtnet: executing yml_node 00010000:00010000:2.0:1786034442.866952:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034443.896679:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034444.850783:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786034444.850815:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636137600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034444.850903:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034444.851071:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636137600 00000100:00100000:2.0:1786034444.851079:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636137600 00000100:00100000:2.0:1786034444.851136:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786034444.851144:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636137600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786034444.851175:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034444.851216:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636137600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034444.851222:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1786034444.851269:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551934380 x1872792636137600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034444.851309:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636137600:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786034444.851587:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786034444.911976:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034445.936049:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034446.180035:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034446.180152:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034446.180384:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608841856 00000100:00100000:3.0:1786034446.180396:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608841856 00000100:00100000:3.0:1786034446.180466:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 201 00000100:00100000:3.0:1786034446.180478:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608841856:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034446.180585:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608841856:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 110us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034446.180594:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 201 00000100:00100000:1.0:1786034446.181061:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608841984 00000100:00100000:1.0:1786034446.181067:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608841984 00000100:00100000:1.0:1786034446.181132:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 52 00000100:00100000:1.0:1786034446.181157:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608841984:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034446.181205:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608841984:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 50us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034446.181212:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 52 00000100:00080000:2.0:1786034446.183160:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034446.896192:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786034446.896220:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636137728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034446.896308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034446.896439:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636137728 00000100:00100000:2.0:1786034446.896448:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636137728 00000100:00100000:2.0:1786034446.896524:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786034446.896534:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636137728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034446.896582:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034446.896633:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636137728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034446.896641:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1786034446.896698:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1786034446.896765:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551935c00 x1872792636137728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034446.896784:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636137728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034446.897020:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636137984:0@lo:400:kworker.0 00000100:00100000:2.0:1786034446.897054:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034446.897082:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786034446.897088:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636138112:0@lo:400:kworker.0 00000100:00100000:2.0:1786034446.897110:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034446.897167:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636137984 00000100:00100000:0.0:1786034446.897172:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636137984 00000100:00100000:0.0:1786034446.897205:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636138112 00000100:00100000:0.0:1786034446.897208:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636138112 00000100:00100000:0.0:1786034446.897231:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786034446.897237:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636137984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034446.897274:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636137984:12345-0@lo:400:kworker.0 Request processed in 38us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034446.897281:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786034446.897293:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786034446.897299:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636138112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034446.897320:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636138112:12345-0@lo:400:kworker.0 Request processed in 22us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034446.897325:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1786034446.897337:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034446.897353:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636138112:0@lo:400:kworker.0 00000100:00100000:0.0:1786034446.897361:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636137984:0@lo:400:kworker.0 00000100:00100000:3.0:1786034446.897456:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636137856:0@lo:400:kworker.0 00000100:00100000:3.0:1786034446.897489:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034446.897516:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636138368:0@lo:400:kworker.0 00000100:00100000:3.0:1786034446.897535:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034446.897553:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786034446.897568:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636138240:0@lo:400:kworker.0 00000100:00100000:3.0:1786034446.897593:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034446.897638:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636138240 00000100:00100000:3.0:1786034446.897642:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636138240 00000100:00100000:3.0:1786034446.897675:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786034446.897681:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636138240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034446.897712:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636138240:12345-0@lo:400:kworker.0 Request processed in 31us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034446.897718:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1786034446.897734:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786034446.897749:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551935180 x1872792636138240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034446.897760:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636138240:0@lo:400:kworker.0 00000100:00100000:2.0:1786034446.897817:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636137856 00000100:00100000:2.0:1786034446.897836:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636137856 00000100:00100000:2.0:1786034446.897869:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1786034446.897875:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636137856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034446.897906:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636137856:12345-0@lo:400:kworker.0 Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034446.897912:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1786034446.897998:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636138368 00000100:00100000:0.0:1786034446.898002:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636138368 00000100:00100000:0.0:1786034446.898041:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786034446.898048:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454767b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636138368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034446.898087:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454767b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636138368:12345-0@lo:400:kworker.0 Request processed in 40us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034446.898094:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1786034446.898166:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034446.898213:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636137856:0@lo:400:kworker.0 00000100:00100000:3.0:1786034446.898223:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636138368:0@lo:400:kworker.0 00010000:00010000:1.0:1786034446.959990:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034447.984021:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034449.008918:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034449.969208:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636138496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034449.969299:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034449.969398:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636138496 00000100:00100000:2.0:1786034449.969407:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636138496 00000100:00080000:1.0:1786034449.969445:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786034449.969495:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786034449.969507:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636138496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786034449.969566:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034449.969615:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636138496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034449.969622:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1786034449.969665:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551937b80 x1872792636138496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034449.969686:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636138496:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786034450.032421:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034451.057914:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034451.305089:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034451.305139:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034451.305169:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608842112 00000100:00100000:0.0:1786034451.305179:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608842112 00000100:00100000:0.0:1786034451.305230:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 203 00000100:00100000:0.0:1786034451.305241:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2363:x1872792608842112:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034451.305309:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2363:x1872792608842112:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 70us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034451.305316:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 203 00000100:00100000:3.0:1786034451.306027:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608842240 00000100:00100000:3.0:1786034451.306032:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608842240 00000100:00100000:3.0:1786034451.306082:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 56 00000100:00100000:3.0:1786034451.306091:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608842240:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034451.306132:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608842240:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 43us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034451.306139:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 56 00000100:00080000:0.0:1786034451.306466:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1786034451.521478:0:9287:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.56.52 00000100:00100000:0.0:1786034452.016050:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636138880:0@lo:400:kworker.0 00000100:00100000:0.0:1786034452.016148:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034452.016203:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786034452.016208:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636138752:0@lo:400:kworker.0 00000100:00100000:0.0:1786034452.016227:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034452.016241:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636139264:0@lo:400:kworker.0 00000100:00100000:0.0:1786034452.016260:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034452.016287:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636138880 00000100:00100000:0.0:1786034452.016293:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636138880 00000100:00100000:0.0:1786034452.016335:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636138752 00000100:00100000:0.0:1786034452.016338:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636138752 00000100:00100000:0.0:1786034452.016355:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1786034452.016362:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636138880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034452.016439:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636138880:12345-0@lo:400:kworker.0 Request processed in 76us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034452.016446:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1786034452.016461:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786034452.016466:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636138752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034452.016486:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636138752:12345-0@lo:400:kworker.0 Request processed in 20us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034452.016491:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786034452.016507:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636139264 00000100:00100000:0.0:1786034452.016510:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636139264 00000100:00100000:3.0:1786034452.016688:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636138624:0@lo:400:kworker.0 00000100:00100000:3.0:1786034452.016720:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034452.016739:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636139136:0@lo:400:kworker.0 00000100:00100000:3.0:1786034452.016766:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034452.016790:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786034452.016796:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636139008:0@lo:400:kworker.0 00000100:00100000:3.0:1786034452.016815:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034452.016871:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636138624 00000100:00100000:3.0:1786034452.016874:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636138624 00000100:00100000:3.0:1786034452.016896:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1786034452.016901:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636138624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034452.016930:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636138624:12345-0@lo:400:kworker.0 Request processed in 29us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034452.016936:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1786034452.016957:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636139008 00000100:00100000:3.0:1786034452.016959:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636139008 00000100:00100000:0.0:1786034452.017058:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786034452.017064:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636139264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034452.017091:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636139264:12345-0@lo:400:kworker.0 Request processed in 27us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034452.017096:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786034452.017110:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636139136 00000100:00100000:0.0:1786034452.017113:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636139136 00000100:00100000:2.0:1786034452.017165:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786034452.017174:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964547679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636139392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034452.017198:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034452.017223:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636139392 00000100:00100000:2.0:1786034452.017226:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636139392 00000100:00100000:2.0:1786034452.017247:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786034452.017252:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636139392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034452.017276:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034452.017303:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636139392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034452.017308:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1786034452.017335:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964547679f80 x1872792636139392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034452.017363:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964547679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636139392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034452.017402:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636138624:0@lo:400:kworker.0 00000100:00100000:2.0:1786034452.017430:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636138752:0@lo:400:kworker.0 00010000:00080000:2.0:1786034452.017439:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551937b80 x1872792636139264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034452.017447:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636139264:0@lo:400:kworker.0 00000100:00100000:2.0:1786034452.017455:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636138880:0@lo:400:kworker.0 00000100:00080000:1.0:1786034452.023900:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786034452.023914:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034452.024665:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786034452.024682:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636139008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034452.024797:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636139008:12345-0@lo:400:kworker.0 Request processed in 122us (7980us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034452.024804:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1786034452.024865:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551935f80 x1872792636139008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034452.024879:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636139008:0@lo:400:kworker.0 00000100:00080000:1.0:1786034452.027657:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786034452.032051:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786034452.032066:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636139136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034452.032166:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636139136:12345-0@lo:400:kworker.0 Request processed in 104us (15408us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034452.032173:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1786034452.034358:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034452.034847:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636139136:0@lo:400:kworker.0 00010000:00010000:2.0:1786034452.082540:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034453.105755:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034454.127970:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034455.088214:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636139520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034455.088282:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034455.088463:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636139520 00000100:00100000:0.0:1786034455.088472:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636139520 00000100:00100000:0.0:1786034455.088546:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786034455.088564:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636139520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034455.088614:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034455.088667:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636139520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034455.088674:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1786034455.088722:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551935c00 x1872792636139520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034455.088742:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636139520:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786034455.088898:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786034455.156196:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034456.176680:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786034456.211601:0:9385:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.56.52 00000100:00100000:2.0:1786034456.418655:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034456.418855:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034456.419542:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608842368 00000100:00100000:1.0:1786034456.419552:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608842368 00000100:00100000:1.0:1786034456.419606:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 205 00000100:00100000:1.0:1786034456.419616:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608842368:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034456.419681:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608842368:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 66us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034456.419689:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 205 00000100:00100000:3.0:1786034456.425130:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608842496 00000100:00100000:3.0:1786034456.425143:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608842496 00000100:00100000:3.0:1786034456.425239:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 60 00000100:00100000:3.0:1786034456.425248:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608842496:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034456.425314:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608842496:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 68us (6666us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034456.425327:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 60 00000100:00080000:1.0:1786034456.429539:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034457.146134:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636139648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034457.146218:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034457.146307:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636139648 00000100:00100000:2.0:1786034457.146315:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636139648 00000100:00100000:2.0:1786034457.146375:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786034457.146385:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636139648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034457.146425:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034457.146469:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636139648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00080000:0.0:1786034457.148068:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786034457.148116:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786034457.148166:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636139776:0@lo:400:kworker.0 00000100:00100000:2.0:1786034457.148229:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034457.148272:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636140288:0@lo:400:kworker.0 00000100:00100000:2.0:1786034457.148298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034457.149592:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636140288 00000100:00100000:3.0:1786034457.149606:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636140288 00000100:00100000:3.0:1786034457.149680:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786034457.149692:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636140288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034457.149768:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636140288:12345-0@lo:400:kworker.0 Request processed in 80us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034457.149776:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786034457.150064:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636139904:0@lo:400:kworker.0 00000100:00100000:3.0:1786034457.150102:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034457.150138:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636139904 00000100:00100000:3.0:1786034457.150142:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636139904 00000100:00100000:3.0:1786034457.150165:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786034457.150172:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454767ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636139904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034457.150203:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454767ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636139904:12345-0@lo:400:kworker.0 Request processed in 33us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034457.150210:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786034457.150248:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636139904:0@lo:400:kworker.0 00000100:00100000:3.0:1786034457.150275:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636140160:0@lo:400:kworker.0 00000100:00100000:3.0:1786034457.150300:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1786034457.150328:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964548a11f80 x1872792636139648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034457.150348:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636139648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034457.150362:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786034457.150381:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636140032:0@lo:400:kworker.0 00000100:00100000:3.0:1786034457.150404:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034457.150423:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636140032 00000100:00100000:3.0:1786034457.150427:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636140032 00000100:00100000:3.0:1786034457.150447:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1786034457.150452:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636140032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034457.150493:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636140032:12345-0@lo:400:kworker.0 Request processed in 40us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034457.150498:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1786034457.150521:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636140032:0@lo:400:kworker.0 00000100:00100000:0.0:1786034457.151009:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636139776 00000100:00100000:0.0:1786034457.151014:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636139776 00000100:00100000:0.0:1786034457.151054:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1786034457.151062:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636139776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034457.151103:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636139776:12345-0@lo:400:kworker.0 Request processed in 43us (2875us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034457.151110:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1786034457.152149:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636139776:0@lo:400:kworker.0 00000100:00100000:2.0:1786034457.152169:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636140288:0@lo:400:kworker.0 00000100:00080000:3.0:1786034457.155147:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034457.155921:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636140160 00000100:00100000:0.0:1786034457.155980:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636140160 00000100:00100000:0.0:1786034457.156049:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1786034457.156060:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454767aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636140160:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786034457.156090:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786034457.156147:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454767aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636140160:12345-0@lo:400:kworker.0 Request processed in 89us (5845us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034457.156155:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1786034457.156220:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551936d80 x1872792636140160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034457.156238:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636140160:0@lo:400:kworker.0 00010000:00010000:3.0:1786034457.210016:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034458.228299:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034459.248017:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786034459.889756:0:9482:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.56.52 00000100:00100000:2.0:1786034460.209125:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636140416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034460.209198:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034460.209349:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636140416 00000100:00100000:1.0:1786034460.209356:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636140416 00000100:00100000:1.0:1786034460.209413:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786034460.209423:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636140416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786034460.209465:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034460.209512:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636140416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034460.209518:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1786034460.209555:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457e070a80 x1872792636140416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034460.209571:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636140416:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786034460.210510:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786034460.274244:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034461.295947:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034461.535177:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034461.535216:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034461.535366:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608842624 00000100:00100000:1.0:1786034461.535375:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608842624 00000100:00100000:1.0:1786034461.535436:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 207 00000100:00100000:1.0:1786034461.535452:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608842624:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034461.535516:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608842624:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 73us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034461.535524:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 207 00000100:00100000:3.0:1786034461.536104:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608842752 00000100:00100000:3.0:1786034461.536109:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608842752 00000100:00100000:3.0:1786034461.536172:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 64 00000100:00100000:3.0:1786034461.536179:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608842752:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034461.536215:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608842752:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 38us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034461.536222:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 64 00000100:00080000:1.0:1786034461.536594:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1786034462.162370:0:9531:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 6 12:40:59 EDT 2026 00000100:00100000:3.0:1786034462.258578:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786034462.258606:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96454767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636140544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034462.258667:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034462.258730:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636140544 00000100:00100000:3.0:1786034462.258737:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636140544 00000100:00100000:3.0:1786034462.258790:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1786034462.258799:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636140544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786034462.258845:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034462.258893:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636140544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034462.258900:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1786034462.258920:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1786034462.258951:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96454767a300 x1872792636140544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034462.258968:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96454767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636140544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034462.259148:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636141056:0@lo:400:kworker.0 00000100:00100000:3.0:1786034462.259192:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034462.259219:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786034462.259225:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636140672:0@lo:400:kworker.0 00000100:00100000:3.0:1786034462.259249:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034462.259267:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96454767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636141184:0@lo:400:kworker.0 00000100:00100000:3.0:1786034462.259289:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034462.259313:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636140800:0@lo:400:kworker.0 00000100:00100000:3.0:1786034462.259335:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034462.259353:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786034462.259358:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636140928:0@lo:400:kworker.0 00000100:00100000:3.0:1786034462.259387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034462.259411:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636141056 00000100:00100000:3.0:1786034462.259414:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636141056 00000100:00100000:3.0:1786034462.259498:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786034462.259503:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636141056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034462.259547:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636141056:12345-0@lo:400:kworker.0 Request processed in 44us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034462.259553:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786034462.259570:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636141184 00000100:00100000:3.0:1786034462.259573:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636141184 00000100:00100000:3.0:1786034462.259594:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636140800 00000100:00100000:3.0:1786034462.259597:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636140800 00000100:00100000:3.0:1786034462.259608:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636140928 00000100:00100000:3.0:1786034462.259610:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636140928 00000100:00100000:3.0:1786034462.259622:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1786034462.259628:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636141184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034462.259657:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636141184:12345-0@lo:400:kworker.0 Request processed in 29us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034462.259663:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1786034462.259675:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1786034462.259680:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636140800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034462.259708:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636140800:12345-0@lo:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034462.259713:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1786034462.259725:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786034462.259731:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636140928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034462.259756:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636140928:12345-0@lo:400:kworker.0 Request processed in 25us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034462.259768:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1786034462.259795:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786034462.259798:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786034462.259814:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636140928:0@lo:400:kworker.0 00000100:00100000:3.0:1786034462.259847:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636140800:0@lo:400:kworker.0 00000100:00100000:3.0:1786034462.259869:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96454767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636141184:0@lo:400:kworker.0 00010000:00080000:3.0:1786034462.259878:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9645747b7100 x1872792636141056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034462.259887:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636141056:0@lo:400:kworker.0 00000100:00100000:0.0:1786034462.259947:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636140672 00000100:00100000:0.0:1786034462.259951:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636140672 00000100:00100000:0.0:1786034462.259987:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1786034462.259993:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636140672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034462.260034:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636140672:12345-0@lo:400:kworker.0 Request processed in 41us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034462.260041:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1786034462.260074:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636140672:0@lo:400:kworker.0 00010000:00010000:2.0:1786034462.323562:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034463.359496:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034464.369432:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034465.328484:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636141312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786034465.328548:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034465.328649:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636141312 00000100:00100000:1.0:1786034465.328657:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636141312 00000100:00100000:1.0:1786034465.328717:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786034465.328726:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636141312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786034465.328757:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034465.328803:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636141312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034465.328842:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1786034465.328885:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457e070a80 x1872792636141312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034465.328904:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636141312:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786034465.329172:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786034465.404777:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034466.417309:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034466.653344:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034466.653380:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034466.653502:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608843008 00000100:00100000:0.0:1786034466.653511:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608843008 00000100:00100000:0.0:1786034466.653575:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 68 00000100:00100000:0.0:1786034466.653585:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2365:x1872792608843008:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034466.653661:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2365:x1872792608843008:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 78us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034466.653669:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 68 00000100:00100000:3.0:1786034466.654606:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608842880 00000100:00100000:3.0:1786034466.654612:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608842880 00000100:00100000:3.0:1786034466.654654:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 209 00000100:00100000:3.0:1786034466.654660:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2365:x1872792608842880:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034466.654700:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2365:x1872792608842880:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 40us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034466.654706:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 209 00000100:00080000:2.0:1786034466.655087:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034467.379771:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636141440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034467.379862:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034467.379940:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636141440 00000100:00100000:3.0:1786034467.379947:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636141440 00000100:00100000:3.0:1786034467.379995:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1786034467.380003:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636141440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786034467.380035:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034467.380074:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636141440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034467.380081:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1786034467.382751:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1786034467.382813:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d41c700 x1872792636141440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034467.382872:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636141440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034467.385061:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636141568:0@lo:400:kworker.0 00000100:00100000:3.0:1786034467.385205:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034467.385243:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636142080:0@lo:400:kworker.0 00000100:00100000:3.0:1786034467.385279:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034467.385299:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034467.385304:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636141696:0@lo:400:kworker.0 00000100:00100000:3.0:1786034467.385335:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034467.385415:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636141568 00000100:00100000:2.0:1786034467.385423:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636141568 00000100:00100000:2.0:1786034467.385465:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1786034467.385473:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636141568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034467.385529:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636141568:12345-0@lo:400:kworker.0 Request processed in 56us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034467.385535:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1786034467.385947:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636141568:0@lo:400:kworker.0 00000100:00100000:3.0:1786034467.385973:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636142080 00000100:00100000:3.0:1786034467.385976:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636142080 00000100:00100000:3.0:1786034467.386008:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636141696 00000100:00100000:3.0:1786034467.386011:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636141696 00000100:00100000:3.0:1786034467.386027:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1786034467.386033:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636142080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034467.386124:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1786034467.386136:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636141696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034467.386170:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636141696:12345-0@lo:400:kworker.0 Request processed in 34us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034467.386175:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1786034467.386272:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636142080:12345-0@lo:400:kworker.0 Request processed in 239us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034467.386279:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1786034467.386305:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636141824:0@lo:400:kworker.0 00000100:00100000:3.0:1786034467.386327:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034467.386473:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786034467.386479:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636141952:0@lo:400:kworker.0 00000100:00100000:3.0:1786034467.386503:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034467.386528:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636141952 00000100:00100000:3.0:1786034467.386531:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636141952 00000100:00100000:3.0:1786034467.386572:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786034467.386578:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636141952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034467.386612:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636141952:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034467.386618:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1786034467.386634:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786034467.386638:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1786034467.386656:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb5180 x1872792636141952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034467.386667:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636141952:0@lo:400:kworker.0 00000100:00100000:3.0:1786034467.386692:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636141696:0@lo:400:kworker.0 00000100:00100000:3.0:1786034467.386701:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636142080:0@lo:400:kworker.0 00000100:00100000:2.0:1786034467.401062:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636141824 00000100:00100000:2.0:1786034467.401076:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636141824 00000100:00100000:2.0:1786034467.401146:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1786034467.401156:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636141824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034467.401246:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636141824:12345-0@lo:400:kworker.0 Request processed in 91us (14917us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034467.401253:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1786034467.401340:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034467.401580:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636141824:0@lo:400:kworker.0 00010000:00010000:2.0:1786034467.448124:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034468.490845:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034469.488062:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034470.449989:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034470.450009:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636142208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786034470.450083:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034470.450255:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636142208 00000100:00100000:1.0:1786034470.450263:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636142208 00000100:00100000:1.0:1786034470.450314:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1786034470.450321:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636142208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786034470.450360:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034470.450410:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636142208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034470.450417:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1786034470.450450:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551934a80 x1872792636142208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034470.450469:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636142208:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786034470.450753:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786034470.512027:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034471.544522:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034471.779318:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034471.781614:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608843136 00000100:00100000:3.0:1786034471.781626:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608843136 00000100:00100000:2.0:1786034471.784153:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 211 00000100:00100000:2.0:1786034471.784166:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2363:x1872792608843136:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034471.784245:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2363:x1872792608843136:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 81us (4934us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034471.784253:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 211 00000100:00100000:3.0:1786034471.793421:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034471.793507:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608843264 00000100:00100000:1.0:1786034471.793516:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608843264 00000100:00100000:1.0:1786034471.793594:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 72 00000100:00100000:1.0:1786034471.793605:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608843264:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034471.793678:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608843264:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 75us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034471.793687:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 72 00000100:00080000:3.0:1786034471.794239:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034472.499076:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636142336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034472.499169:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034472.499430:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636142336 00000100:00100000:1.0:1786034472.499441:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636142336 00000100:00100000:1.0:1786034472.499543:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786034472.499554:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636142336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786034472.499598:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034472.499655:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636142336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034472.499662:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1786034472.500282:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786034472.500388:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636142592:0@lo:400:kworker.0 00000100:00100000:3.0:1786034472.500423:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034472.500446:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034472.500452:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636142720:0@lo:400:kworker.0 00000100:00100000:3.0:1786034472.500474:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034472.500515:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636142592 00000100:00100000:3.0:1786034472.500520:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636142592 00000100:00100000:3.0:1786034472.500548:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636142720 00000100:00100000:3.0:1786034472.500550:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636142720 00000100:00100000:3.0:1786034472.500571:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786034472.500576:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636142592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034472.500614:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636142592:12345-0@lo:400:kworker.0 Request processed in 37us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034472.500620:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786034472.500633:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786034472.500640:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636142720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034472.500666:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636142720:12345-0@lo:400:kworker.0 Request processed in 27us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034472.500678:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786034472.500707:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636142464:0@lo:400:kworker.0 00000100:00100000:3.0:1786034472.500740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034472.500762:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636142976:0@lo:400:kworker.0 00000100:00100000:3.0:1786034472.500784:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034472.500801:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786034472.500807:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636142848:0@lo:400:kworker.0 00000100:00100000:3.0:1786034472.500844:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034472.500867:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636142464 00000100:00100000:3.0:1786034472.500870:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636142464 00000100:00100000:3.0:1786034472.500895:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1786034472.500900:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636142464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034472.501454:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636142464:12345-0@lo:400:kworker.0 Request processed in 552us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034472.501461:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1786034472.501503:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636142848 00000100:00100000:3.0:1786034472.501507:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636142848 00000100:00100000:3.0:1786034472.501538:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786034472.501545:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636142848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034472.501576:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636142848:12345-0@lo:400:kworker.0 Request processed in 32us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034472.501583:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1786034472.501605:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786034472.501609:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034472.501638:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636142720:0@lo:400:kworker.0 00000100:00100000:3.0:1786034472.501661:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636142592:0@lo:400:kworker.0 00010000:00080000:3.0:1786034472.501691:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d41f480 x1872792636142848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034472.501702:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636142848:0@lo:400:kworker.0 00000100:00100000:3.0:1786034472.501709:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636142464:0@lo:400:kworker.0 00000100:00100000:3.0:1786034472.501720:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636142976 00000100:00100000:3.0:1786034472.501723:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636142976 00000100:00100000:3.0:1786034472.501766:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1786034472.501771:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636142976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034472.501799:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636142976:12345-0@lo:400:kworker.0 Request processed in 28us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034472.501805:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1786034472.501817:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1786034472.501875:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457e070a80 x1872792636142336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034472.501891:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636142336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034472.501914:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636142976:0@lo:400:kworker.0 00010000:00010000:3.0:1786034472.560023:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034473.584658:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034474.613023:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034475.572350:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636143104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034475.572427:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034475.572721:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636143104 00000100:00100000:0.0:1786034475.572729:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636143104 00000100:00100000:0.0:1786034475.572794:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786034475.572804:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636143104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034475.572853:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034475.572896:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636143104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034475.572903:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1786034475.572950:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551937b80 x1872792636143104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034475.572968:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636143104:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786034475.576783:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786034475.632865:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034476.658791:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034476.894792:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034476.894855:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034476.894936:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608843520 00000100:00100000:3.0:1786034476.894945:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608843520 00000100:00100000:3.0:1786034476.895022:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 76 00000100:00100000:3.0:1786034476.895031:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608843520:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034476.895117:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608843520:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 86us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034476.895124:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 76 00000100:00080000:3.0:1786034476.895233:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034476.917261:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608843392 00000100:00100000:2.0:1786034476.917286:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608843392 00000100:00100000:2.0:1786034476.917357:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 213 00000100:00100000:2.0:1786034476.917367:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608843392:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034476.917437:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608843392:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 72us (22582us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034476.917443:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 213 00000100:00100000:0.0:1786034477.617596:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636143232:0@lo:400:kworker.0 00000100:00100000:0.0:1786034477.617701:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034477.617752:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636143744:0@lo:400:kworker.0 00000100:00100000:0.0:1786034477.617779:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034477.617804:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786034477.617809:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636143616:0@lo:400:kworker.0 00000100:00100000:0.0:1786034477.617852:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034477.617878:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636143360:0@lo:400:kworker.0 00000100:00100000:0.0:1786034477.617898:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034477.617912:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636143872:0@lo:400:kworker.0 00000100:00100000:0.0:1786034477.617929:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034477.617943:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786034477.617947:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636143488:0@lo:400:kworker.0 00000100:00100000:0.0:1786034477.617963:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034477.619755:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636143232 00000100:00100000:0.0:1786034477.619765:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636143232 00000100:00100000:0.0:1786034477.619843:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1786034477.619852:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636143232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034477.619915:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636143232:12345-0@lo:400:kworker.0 Request processed in 64us (2214us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034477.619922:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1786034477.619954:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636143744 00000100:00100000:0.0:1786034477.619957:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636143744 00000100:00100000:0.0:1786034477.620000:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636143360 00000100:00100000:0.0:1786034477.620003:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636143360 00000100:00100000:0.0:1786034477.620022:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636143488 00000100:00100000:0.0:1786034477.620025:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636143488 00000100:00100000:0.0:1786034477.620038:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1786034477.620043:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636143744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034477.620071:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636143744:12345-0@lo:400:kworker.0 Request processed in 29us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034477.620076:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1786034477.620087:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1786034477.620091:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636143360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034477.620110:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636143360:12345-0@lo:400:kworker.0 Request processed in 19us (2211us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034477.620114:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1786034477.620122:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1786034477.620126:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636143488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034477.620144:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636143488:12345-0@lo:400:kworker.0 Request processed in 18us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034477.620149:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1786034477.620164:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636143616 00000100:00100000:0.0:1786034477.620167:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636143616 00000100:00100000:0.0:1786034477.620187:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636143872 00000100:00100000:0.0:1786034477.620189:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636143872 00000100:00100000:0.0:1786034477.620206:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786034477.620211:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636143616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034477.620235:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636143616:12345-0@lo:400:kworker.0 Request processed in 24us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034477.620732:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786034477.620746:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786034477.620757:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636143872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034477.620796:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636143872:12345-0@lo:400:kworker.0 Request processed in 39us (2866us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034477.620801:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1786034477.620881:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786034477.620886:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034477.620889:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786034477.620922:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551934a80 x1872792636143616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034477.620938:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636143616:0@lo:400:kworker.0 00000100:00100000:1.0:1786034477.620948:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636143232:0@lo:400:kworker.0 00000100:00100000:1.0:1786034477.620958:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636143744:0@lo:400:kworker.0 00000100:00100000:1.0:1786034477.621008:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636143488:0@lo:400:kworker.0 00000100:00100000:1.0:1786034477.621017:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636143360:0@lo:400:kworker.0 00010000:00080000:1.0:1786034477.621027:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551935f80 x1872792636143872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034477.621037:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636143872:0@lo:400:kworker.0 00000100:00100000:1.0:1786034477.621053:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786034477.621062:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636144000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786034477.621093:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034477.621253:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636144000 00000100:00100000:0.0:1786034477.621257:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636144000 00000100:00100000:0.0:1786034477.621288:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1786034477.621294:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636144000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786034477.621335:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034477.621371:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636144000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034477.621376:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1786034477.621399:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457e070380 x1872792636144000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034477.621414:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636144000:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786034477.680007:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034478.743343:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034479.793911:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034480.692981:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786034480.693009:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636144128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786034480.693095:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034480.693236:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636144128 00000100:00100000:1.0:1786034480.693245:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636144128 00000100:00100000:1.0:1786034480.693323:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1786034480.693333:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636144128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786034480.693374:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034480.693419:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636144128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034480.693426:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1786034480.693470:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457e072680 x1872792636144128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034480.693489:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636144128:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786034480.693692:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786034480.827666:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034481.841159:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034482.020149:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034482.020198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034482.020347:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608843776 00000100:00100000:1.0:1786034482.020360:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608843776 00000100:00100000:1.0:1786034482.020448:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 80 00000100:00100000:1.0:1786034482.020461:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2365:x1872792608843776:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034482.020566:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2365:x1872792608843776:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 108us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034482.020574:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 80 00000100:00080000:0.0:1786034482.022396:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034482.022571:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608843648 00000100:00100000:3.0:1786034482.022582:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608843648 00000100:00100000:3.0:1786034482.022719:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 215 00000100:00100000:3.0:1786034482.022730:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2365:x1872792608843648:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034482.022798:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2365:x1872792608843648:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 71us (2661us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034482.022806:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 215 00000100:00100000:0.0:1786034482.744323:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034482.744351:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636144256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034482.744435:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034482.744625:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636144256 00000100:00100000:2.0:1786034482.744637:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636144256 00000100:00100000:2.0:1786034482.744720:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786034482.744731:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636144256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034482.744776:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034482.744855:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636144256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034482.744863:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1786034482.744908:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d1c0e00 x1872792636144256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034482.744931:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636144256:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1786034482.745010:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786034482.745615:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636144640:0@lo:400:kworker.0 00000100:00100000:2.0:1786034482.745729:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636144512:0@lo:400:kworker.0 00000100:00100000:1.0:1786034482.750168:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636144384:0@lo:400:kworker.0 00000100:00100000:1.0:1786034482.750255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034482.750322:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96454767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636144896:0@lo:400:kworker.0 00000100:00100000:1.0:1786034482.750359:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636144768:0@lo:400:kworker.0 00000100:00100000:1.0:1786034482.750389:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034482.750438:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636144768 00000100:00100000:1.0:1786034482.750454:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636144768 00000100:00100000:1.0:1786034482.750519:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786034482.750529:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636144768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034482.750591:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636144768:12345-0@lo:400:kworker.0 Request processed in 63us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034482.750599:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1786034482.750621:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786034482.750664:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d41d180 x1872792636144768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034482.750680:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636144768:0@lo:400:kworker.0 00000100:00100000:3.0:1786034482.751115:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034482.751287:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636144640 00000100:00100000:3.0:1786034482.751292:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636144640 00000100:00100000:3.0:1786034482.751329:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1786034482.751336:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636144640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034482.751407:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636144640:12345-0@lo:400:kworker.0 Request processed in 71us (5753us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034482.751423:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1786034482.751442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034482.751471:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786034482.751493:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034482.751502:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636144896 00000100:00100000:3.0:1786034482.751506:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636144896 00000100:00100000:3.0:1786034482.751530:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636144512 00000100:00100000:3.0:1786034482.751533:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636144512 00000100:00100000:3.0:1786034482.751547:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1786034482.751553:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636144896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034482.751587:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636144896:12345-0@lo:400:kworker.0 Request processed in 35us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034482.751593:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1786034482.751605:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1786034482.751611:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636144512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034482.751640:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636144512:12345-0@lo:400:kworker.0 Request processed in 30us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034482.751646:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1786034482.751716:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034482.751737:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96454767a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636144896:0@lo:400:kworker.0 00000100:00100000:3.0:1786034482.751762:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636144512:0@lo:400:kworker.0 00000100:00100000:3.0:1786034482.751785:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636144640:0@lo:400:kworker.0 00000100:00100000:2.0:1786034482.759476:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636144384 00000100:00100000:2.0:1786034482.759496:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636144384 00000100:00100000:2.0:1786034482.759571:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1786034482.759584:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636144384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034482.766703:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636144384:12345-0@lo:400:kworker.0 Request processed in 7107us (16432us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034482.766744:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1786034482.766992:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636144384:0@lo:400:kworker.0 00010000:00010000:1.0:1786034482.863971:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034483.888996:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034484.913219:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034485.808124:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786034485.808154:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636145024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034485.808243:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034485.808532:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636145024 00000100:00100000:1.0:1786034485.808543:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636145024 00000100:00100000:1.0:1786034485.808628:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786034485.808636:0:6723:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1786034485.808638:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636145024:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786034485.808647:0:6723:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1786034485.808682:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034485.808740:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636145024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034485.808747:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1786034485.808792:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457e070380 x1872792636145024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034485.808812:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636145024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786034485.808898:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786034485.936570:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034486.962925:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034487.139107:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034487.139555:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034487.145108:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608843904 00000100:00100000:1.0:1786034487.145135:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608843904 00000100:00100000:1.0:1786034487.145219:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 217 00000100:00100000:1.0:1786034487.145229:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608843904:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034487.145359:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2362:x1872792608843904:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 124us (5797us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034487.145368:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 217 00000100:00100000:0.0:1786034487.147518:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608844032 00000100:00100000:0.0:1786034487.147531:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608844032 00000100:00100000:0.0:1786034487.147653:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 84 00000100:00100000:0.0:1786034487.147664:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608844032:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034487.149059:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608844032:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 1393us (9961us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034487.149069:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 84 00000100:00080000:3.0:1786034487.156683:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034487.856345:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636145152:0@lo:400:kworker.0 00000100:00100000:3.0:1786034487.857604:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034487.857660:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034487.857668:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636145280:0@lo:400:kworker.0 00000100:00100000:3.0:1786034487.857697:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034487.857734:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636145280 00000100:00100000:3.0:1786034487.857740:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636145280 00000100:00100000:3.0:1786034487.857784:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1786034487.857792:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454767a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636145280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034487.857853:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454767a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636145280:12345-0@lo:400:kworker.0 Request processed in 62us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034487.857860:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1786034487.857902:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636145280:0@lo:400:kworker.0 00000100:00100000:1.0:1786034487.858109:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636145792:0@lo:400:kworker.0 00000100:00100000:1.0:1786034487.858143:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034487.858165:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786034487.858170:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636145664:0@lo:400:kworker.0 00000100:00100000:1.0:1786034487.858190:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034487.858214:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636145664 00000100:00100000:1.0:1786034487.858217:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636145664 00000100:00100000:1.0:1786034487.858267:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1786034487.858274:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636145664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034487.858307:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636145664:12345-0@lo:400:kworker.0 Request processed in 34us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034487.858312:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1786034487.858794:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636145664:0@lo:400:kworker.0 00000100:00100000:1.0:1786034487.858814:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455185b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636145408:0@lo:400:kworker.0 00000100:00100000:1.0:1786034487.858859:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034487.858875:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786034487.858881:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636145536:0@lo:400:kworker.0 00000100:00100000:1.0:1786034487.858899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034487.858938:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636145792 00000100:00100000:1.0:1786034487.858942:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636145792 00000100:00100000:1.0:1786034487.858968:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636145536 00000100:00100000:1.0:1786034487.858971:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636145536 00000100:00100000:1.0:1786034487.858988:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1786034487.859002:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636145792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034487.859036:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636145792:12345-0@lo:400:kworker.0 Request processed in 35us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034487.859041:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1786034487.859053:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786034487.859058:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636145536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034487.859089:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636145536:12345-0@lo:400:kworker.0 Request processed in 30us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034487.859095:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1786034487.859128:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551858a80 x1872792636145792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034487.859138:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636145792:0@lo:400:kworker.0 00000100:00100000:1.0:1786034487.859155:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636145408 00000100:00100000:1.0:1786034487.859158:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636145408 00000100:00100000:1.0:1786034487.859179:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1786034487.859185:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636145408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034487.859225:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636145408:12345-0@lo:400:kworker.0 Request processed in 40us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034487.859241:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1786034487.859266:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551859500 x1872792636145536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034487.859275:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636145536:0@lo:400:kworker.0 00000100:00100000:1.0:1786034487.859284:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455185b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636145408:0@lo:400:kworker.0 00000100:00100000:2.0:1786034487.860557:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636145152 00000100:00100000:2.0:1786034487.860570:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636145152 00000100:00100000:2.0:1786034487.860643:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1786034487.860652:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636145152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034487.860736:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636145152:12345-0@lo:400:kworker.0 Request processed in 85us (3133us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034487.860744:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1786034487.860855:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636145152:0@lo:400:kworker.0 00000100:00080000:3.0:1786034487.860866:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786034487.860875:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786034487.860878:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034487.864385:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786034487.864409:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636145920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034487.864474:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034487.866882:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636145920 00000100:00100000:3.0:1786034487.866895:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636145920 00000100:00100000:3.0:1786034487.866980:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786034487.866991:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636145920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786034487.867038:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1786034487.867324:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551859f80 x1872792636145920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034487.867346:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636145920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034487.867756:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636145920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 766us (3279us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034487.867765:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1786034487.986020:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786034488.838988:0:10163:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:41:26 (1786034486) === 00010000:00010000:1.0:1786034489.008212:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034489.664640:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034489.664870:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608844160 00000100:00100000:0.0:1786034489.664882:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608844160 00000100:00100000:0.0:1786034489.664951:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 219 00000100:00100000:0.0:1786034489.664962:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:8143:x1872792608844160:12345-192.168.203.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786034489.664984:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034489.665006:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964582166800/0x490975051af3fc6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758563 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034489.665039:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964582166800/0x490975051af3fc6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758563 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034489.665052:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964582166800/0x490975051af3fc6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758563 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034489.665063:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964582166800, rc 0) 00000100:00100000:0.0:1786034489.665134:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+11:8143:x1872792608844160:12345-192.168.203.56@tcp:101:mount.lustre.0 Request processed in 174us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034489.665141:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 219 00000100:00100000:1.0:1786034489.697547:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034489.697685:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608844288 00000100:00100000:0.0:1786034489.697702:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608844288 00000100:00100000:0.0:1786034489.697770:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 220 00000100:00100000:0.0:1786034489.697781:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+11:8143:x1872792608844288:12345-192.168.203.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1786034489.698354:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+11:8143:x1872792608844288:12345-192.168.203.56@tcp:501:mount.lustre.0 Request processed in 574us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034489.698370:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 220 00000100:00100000:3.0:1786034489.702872:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034489.705630:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608844416 00000100:00100000:2.0:1786034489.705646:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608844416 00000100:00100000:2.0:1786034489.705728:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 221 00000100:00100000:2.0:1786034489.705740:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+11:8143:x1872792608844416:12345-192.168.203.56@tcp:503:mount.lustre.0 00000100:00100000:2.0:1786034489.706083:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+11:8143:x1872792608844416:12345-192.168.203.56@tcp:503:mount.lustre.0 Request processed in 344us (3264us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034489.706098:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 221 00000100:00100000:1.0:1786034489.711108:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034489.711261:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608844544 00000100:00100000:0.0:1786034489.711272:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608844544 00000100:00100000:0.0:1786034489.711336:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 222 00000100:00100000:0.0:1786034489.711348:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+11:8147:x1872792608844544:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786034489.711672:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+11:8147:x1872792608844544:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 324us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034489.711680:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 222 00000100:00100000:1.0:1786034489.735554:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034489.735634:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608844672 00000100:00100000:3.0:1786034489.735645:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608844672 00000100:00100000:3.0:1786034489.735727:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 223 00000100:00100000:3.0:1786034489.735737:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+11:8147:x1872792608844672:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786034489.736097:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+11:8147:x1872792608844672:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 361us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034489.736105:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 223 00000100:00100000:3.0:1786034489.752735:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034489.769505:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608844800 00000100:00100000:2.0:1786034489.769523:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608844800 00000100:00100000:2.0:1786034489.769600:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 224 00000100:00100000:2.0:1786034489.769610:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+11:8143:x1872792608844800:12345-192.168.203.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786034489.769630:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034489.769659:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9645413f1e00/0x490975051af3fc75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75858d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034489.769705:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f1e00/0x490975051af3fc75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75858d expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034489.769723:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9645413f1e00/0x490975051af3fc75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75858d expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034489.769732:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f1e00, rc 0) 00000100:00100000:2.0:1786034489.770295:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:8143:x1872792608844800:12345-192.168.203.56@tcp:101:mount.lustre.0 Request processed in 684us (17580us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034489.770303:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 224 00000100:00100000:1.0:1786034489.793085:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034489.793329:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608844928 00000100:00100000:0.0:1786034489.793340:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608844928 00000100:00100000:0.0:1786034489.793412:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 225 00000100:00100000:0.0:1786034489.793424:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:8143:x1872792608844928:12345-192.168.203.56@tcp:256:mount.lustre.0 20000000:01000000:0.0:1786034489.793456:0:5855:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1786034489.793485:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1786034489.793489:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1786034489.793493:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1786034489.793495:0:5855:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1786034489.805245:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:8143:x1872792608844928:12345-192.168.203.56@tcp:256:mount.lustre.0 Request processed in 11808us (12157us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034489.805263:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 225 00000100:00100000:3.0:1786034489.817094:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034489.817454:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608845056 00000100:00100000:0.0:1786034489.817466:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608845056 00000100:00100000:0.0:1786034489.817535:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 226 00000100:00100000:0.0:1786034489.817546:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:8143:x1872792608845056:12345-192.168.203.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786034489.817567:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034489.817605:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964582167800/0x490975051af3fc7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758594 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034489.817641:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964582167800/0x490975051af3fc7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758594 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034489.817654:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964582167800/0x490975051af3fc7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758594 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034489.817665:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964582167800, rc 0) 00000100:00100000:0.0:1786034489.817736:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:8143:x1872792608845056:12345-192.168.203.56@tcp:101:mount.lustre.0 Request processed in 191us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034489.817743:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 226 00000100:00100000:1.0:1786034489.824099:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034489.824662:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608845184 00000100:00100000:0.0:1786034489.824674:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608845184 00000100:00100000:0.0:1786034489.824755:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 227 00000100:00100000:0.0:1786034489.824767:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:8143:x1872792608845184:12345-192.168.203.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1786034489.826156:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:8143:x1872792608845184:12345-192.168.203.56@tcp:501:mount.lustre.0 Request processed in 1387us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034489.826166:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 227 00000100:00100000:1.0:1786034489.851982:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034489.852359:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608845312 00000100:00100000:2.0:1786034489.852372:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608845312 00000100:00100000:2.0:1786034489.852443:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 228 00000100:00100000:2.0:1786034489.852455:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:8143:x1872792608845312:12345-192.168.203.56@tcp:503:mount.lustre.0 00000100:00100000:2.0:1786034489.852725:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:8143:x1872792608845312:12345-192.168.203.56@tcp:503:mount.lustre.0 Request processed in 272us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034489.852734:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 228 00000100:00100000:3.0:1786034489.856342:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034489.860588:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608845440 00000100:00100000:0.0:1786034489.860604:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608845440 00000100:00100000:0.0:1786034489.860680:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 229 00000100:00100000:0.0:1786034489.860691:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:8150:x1872792608845440:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786034489.861078:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:8150:x1872792608845440:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 387us (5170us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034489.861086:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 229 00000100:00100000:1.0:1786034489.881962:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034489.882106:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608845568 00000100:00100000:2.0:1786034489.882119:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608845568 00000100:00100000:2.0:1786034489.882191:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 230 00000100:00100000:2.0:1786034489.882203:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:8150:x1872792608845568:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786034489.882524:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:8150:x1872792608845568:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 322us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034489.882533:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 230 00000100:00100000:2.0:1786034489.896787:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034489.897489:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608845696 00000100:00100000:1.0:1786034489.897504:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608845696 00000100:00100000:1.0:1786034489.897574:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:1.0:1786034489.897585:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2361:x1872792608845696:12345-192.168.203.56@tcp:38:mount.lustre.0 00010000:00080000:1.0:1786034489.897626:0:5863:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 46043387-e7a3-40ab-b2ac-2e46aee761ed@192.168.203.56@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:1.0:1786034489.897673:0:5863:0:(genops.c:1406:class_connect()) connect: client 46043387-e7a3-40ab-b2ac-2e46aee761ed, cookie 0x490975051af3fc83 00000004:00100000:1.0:1786034489.897711:0:5863:0:(mdt_handler.c:7328:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1786034489.898408:0:5863:0:(import.c:65:import_set_state_nolock()) ffff964548b36800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786034489.898621:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2361:x1872792608845696:12345-192.168.203.56@tcp:38:mount.lustre.0 Request processed in 1035us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034489.898631:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:1.0:1786034489.904939:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034489.904984:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034489.905161:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608845952 00000100:00100000:0.0:1786034489.905182:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608845952 00000100:00100000:0.0:1786034489.905268:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608845824 00000100:00100000:0.0:1786034489.905272:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608845824 00000100:00100000:0.0:1786034489.905291:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00100000:0.0:1786034489.905301:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+7:8143:x1872792608845952:12345-192.168.203.56@tcp:41:mount.lustre.0 00000004:00000024:0.0:1786034489.905354:0:5862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1786034489.906556:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034489.907116:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:3.0:1786034489.907138:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+7:0:x1872792608845824:12345-192.168.203.56@tcp:41:mount.lustre.0 00000004:00000024:3.0:1786034489.907180:0:5861:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1786034489.910266:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+7:8143:x1872792608845952:12345-192.168.203.56@tcp:41:mount.lustre.0 Request processed in 4953us (5326us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034489.910281:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00100000:3.0:1786034489.910485:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:0:x1872792608845824:12345-192.168.203.56@tcp:41:mount.lustre.0 Request processed in 3352us (5494us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034489.910497:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:3.0:1786034489.918561:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034489.918663:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608846080 00000100:00100000:1.0:1786034489.918675:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608846080 00000100:00100000:1.0:1786034489.918758:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 13 00000100:00100000:1.0:1786034489.918770:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:8143:x1872792608846080:12345-192.168.203.56@tcp:40:mount.lustre.0 00000100:00100000:1.0:1786034489.918899:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:8143:x1872792608846080:12345-192.168.203.56@tcp:40:mount.lustre.0 Request processed in 131us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034489.918938:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 13 00000100:00100000:2.0:1786034489.921355:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034489.921391:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034489.921467:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608846464 00000100:00100000:3.0:1786034489.921481:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608846464 00000100:00100000:2.0:1786034489.921548:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034489.921557:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 1 00000100:00100000:3.0:1786034489.921645:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:8143:x1872792608846464:12345-192.168.203.56@tcp:33:mount.lustre.0 00000004:00200000:3.0:1786034489.922071:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1786034489.922211:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:8143:x1872792608846464:12345-192.168.203.56@tcp:33:mount.lustre.0 Request processed in 643us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034489.922231:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 1 00000100:00100000:2.0:1786034489.926939:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034489.931392:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608846592 00000100:00100000:3.0:1786034489.931410:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608846592 00000100:00100000:3.0:1786034489.931500:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 88 00000100:00100000:3.0:1786034489.931512:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608846592:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034489.931605:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608846592:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 96us (4673us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034489.931613:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 88 00000100:00080000:3.0:1786034489.931641:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034489.935479:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608846208 00000100:00100000:1.0:1786034489.935492:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608846208 00000100:00100000:1.0:1786034489.935542:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608846336 00000100:00100000:1.0:1786034489.935545:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608846336 00000100:00100000:1.0:1786034489.935576:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:1.0:1786034489.935584:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1872792608846208:12345-192.168.203.56@tcp:8:mount.lustre.0 00010000:00080000:1.0:1786034489.935614:0:6721:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 46043387-e7a3-40ab-b2ac-2e46aee761ed@192.168.203.56@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:1.0:1786034489.936732:0:6721:0:(genops.c:1406:class_connect()) connect: client 46043387-e7a3-40ab-b2ac-2e46aee761ed, cookie 0x490975051af3fc8a 00002000:00100000:1.0:1786034489.936747:0:6721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 46043387-e7a3-40ab-b2ac-2e46aee761ed/ffff964548b33000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113834 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1786034489.936769:0:6721:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1786034489.937016:0:6721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1786034489.937057:0:6721:0:(import.c:65:import_set_state_nolock()) ffff964548b31800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786034489.937113:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2361:x1872792608846208:12345-192.168.203.56@tcp:8:mount.lustre.0 Request processed in 1529us (15721us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034489.937122:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:1.0:1786034489.937144:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 13 00000100:00100000:1.0:1786034489.937150:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1872792608846336:12345-192.168.203.56@tcp:8:mount.lustre.0 00010000:00080000:1.0:1786034489.937169:0:6721:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 46043387-e7a3-40ab-b2ac-2e46aee761ed@192.168.203.56@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:1.0:1786034489.937186:0:6721:0:(genops.c:1406:class_connect()) connect: client 46043387-e7a3-40ab-b2ac-2e46aee761ed, cookie 0x490975051af3fc91 00002000:00100000:1.0:1786034489.937191:0:6721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 46043387-e7a3-40ab-b2ac-2e46aee761ed/ffff964548b35000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113834 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1786034489.937205:0:6721:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1786034489.937518:0:6721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1786034489.937544:0:6721:0:(import.c:65:import_set_state_nolock()) ffff964548b34000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786034489.937569:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2361:x1872792608846336:12345-192.168.203.56@tcp:8:mount.lustre.0 Request processed in 418us (16023us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034489.937577:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 13 00010000:00010000:3.0:1786034490.034712:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1786034490.569673:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 46043387-e7a3-40ab-b2ac-2e46aee761ed 00000100:00100000:0.0:1786034490.928115:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786034490.928137:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636146048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786034490.928201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034490.928695:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636146048 00000100:00100000:1.0:1786034490.928704:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636146048 00000100:00100000:1.0:1786034490.928759:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786034490.928769:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636146048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786034490.928790:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034490.928847:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636146048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034490.928854:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1786034490.928913:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1786034490.928992:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551935f80 x1872792636146048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034490.929012:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636146048:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1786034490.975987:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 46043387-e7a3-40ab-b2ac-2e46aee761ed 00010000:00010000:2.0:1786034491.056027:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786034491.498022:0:6746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 46043387-e7a3-40ab-b2ac-2e46aee761ed 00010000:00010000:1.0:1786034492.081043:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034492.976458:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636146432:0@lo:400:kworker.0 00000100:00100000:3.0:1786034492.976518:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034492.976664:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636146176:0@lo:400:kworker.0 00000100:00100000:0.0:1786034492.976697:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034492.976745:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786034492.976751:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636146560:0@lo:400:kworker.0 00000100:00100000:3.0:1786034492.976774:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034492.978163:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786034492.978173:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636146944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034492.978217:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034492.978250:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636146944 00000100:00100000:3.0:1786034492.978256:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636146944 00000100:00100000:3.0:1786034492.978302:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1786034492.978310:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636146944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786034492.978340:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034492.978397:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636146944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034492.978403:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1786034492.978420:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1786034492.978442:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574d15c00 x1872792636146944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034492.978460:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636146944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786034492.980037:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636146304:0@lo:400:kworker.0 00000100:00100000:1.0:1786034492.980137:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034492.980160:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636146816:0@lo:400:kworker.0 00000100:00100000:1.0:1786034492.980182:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034492.980219:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636146432 00000100:00100000:1.0:1786034492.980225:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636146432 00000100:00100000:1.0:1786034492.980256:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636146304 00000100:00100000:1.0:1786034492.980259:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636146304 00000100:00100000:1.0:1786034492.980274:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1786034492.980281:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636146432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034492.980318:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636146432:12345-0@lo:400:kworker.0 Request processed in 37us (3799us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034492.980335:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1786034492.980475:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1786034492.980481:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636146304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034492.980511:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636146304:12345-0@lo:400:kworker.0 Request processed in 31us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034492.980517:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1786034492.980532:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636146176 00000100:00100000:1.0:1786034492.980536:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636146176 00000100:00100000:1.0:1786034492.980555:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1786034492.980560:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636146176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034492.980586:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636146176:12345-0@lo:400:kworker.0 Request processed in 26us (3888us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034492.980592:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1786034492.980701:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636146560 00000100:00100000:1.0:1786034492.980705:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636146560 00000100:00100000:1.0:1786034492.980730:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636146816 00000100:00100000:1.0:1786034492.980732:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636146816 00000100:00100000:1.0:1786034492.980746:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786034492.980751:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636146560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034492.980779:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636146560:12345-0@lo:400:kworker.0 Request processed in 28us (4003us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034492.980784:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786034492.980793:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786034492.980798:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636146816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034492.980817:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636146816:12345-0@lo:400:kworker.0 Request processed in 20us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034492.980961:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786034492.981006:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636146304:0@lo:400:kworker.0 00010000:00080000:1.0:1786034492.981016:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574d14380 x1872792636146816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034492.981026:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636146816:0@lo:400:kworker.0 00000100:00080000:1.0:1786034492.981176:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034492.981181:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786034492.981209:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574d17100 x1872792636146560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034492.981218:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636146560:0@lo:400:kworker.0 00000100:00100000:1.0:1786034492.981228:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636146432:0@lo:400:kworker.0 00000100:00100000:0.0:1786034492.981714:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636146176:0@lo:400:kworker.0 00000100:00100000:0.0:1786034492.981723:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636146688:0@lo:400:kworker.0 00000100:00100000:0.0:1786034492.981751:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034492.981835:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636146688 00000100:00100000:1.0:1786034492.981840:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636146688 00000100:00100000:1.0:1786034492.981875:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1786034492.981880:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636146688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034492.981915:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636146688:12345-0@lo:400:kworker.0 Request processed in 34us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034492.981920:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1786034492.981942:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636146688:0@lo:400:kworker.0 00000100:00080000:0.0:1786034492.981991:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786034493.104986:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034494.128081:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034495.157920:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034495.341958:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034495.341992:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034495.342019:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034495.342037:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034495.342058:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034495.342083:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608847104 00000100:00100000:3.0:1786034495.342091:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608847104 00000100:00100000:3.0:1786034495.342140:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608847232 00000100:00100000:3.0:1786034495.342143:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608847232 00000100:00100000:3.0:1786034495.342163:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 39 00000100:00100000:3.0:1786034495.342183:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608847104:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034495.342247:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608847104:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 75us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034495.342255:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 39 00000100:00100000:3.0:1786034495.342270:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 40 00000100:00100000:3.0:1786034495.342276:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608847232:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034495.342296:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608847232:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 20us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034495.342317:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 40 00000100:00100000:3.0:1786034495.342333:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608846720 00000100:00100000:3.0:1786034495.342336:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608846720 00000100:00100000:3.0:1786034495.342357:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 232 00000100:00100000:3.0:1786034495.342363:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608846720:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034495.342385:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608846720:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 23us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034495.342391:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 232 00000100:00100000:3.0:1786034495.342417:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608846848 00000100:00100000:3.0:1786034495.342420:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608846848 00000100:00100000:3.0:1786034495.342445:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608846976 00000100:00100000:3.0:1786034495.342448:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608846976 00000100:00100000:3.0:1786034495.342469:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 92 00000100:00100000:3.0:1786034495.342475:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608846848:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034495.342502:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608846848:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 27us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034495.342508:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 92 00000100:00100000:3.0:1786034495.342521:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 93 00000100:00100000:3.0:1786034495.342526:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608846976:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034495.342547:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608846976:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 21us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034495.342554:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 93 00000100:00080000:3.0:1786034495.342572:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786034495.342577:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786034495.342579:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786034496.048407:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786034496.048429:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636147072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034496.048495:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034496.048568:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636147072 00000100:00100000:2.0:1786034496.048575:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636147072 00000100:00100000:2.0:1786034496.048628:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1786034496.048636:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636147072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786034496.048671:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034496.048718:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636147072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034496.048740:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1786034496.048779:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574c82300 x1872792636147072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034496.048795:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636147072:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786034496.049062:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786034496.177232:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034497.200095:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034498.096581:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786034498.096604:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636147200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034498.096671:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034498.098508:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636147200 00000100:00100000:3.0:1786034498.098519:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636147200 00000100:00100000:3.0:1786034498.098603:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1786034498.098613:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636147200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786034498.098648:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034498.098712:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636147200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034498.098720:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1786034498.098787:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1786034498.098818:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574d17480 x1872792636147200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034498.098860:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636147200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034498.109523:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636147328:0@lo:400:kworker.0 00000100:00100000:2.0:1786034498.109600:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034498.109752:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636147328 00000100:00100000:1.0:1786034498.109758:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636147328 00000100:00100000:1.0:1786034498.109804:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1786034498.109811:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636147328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034498.109920:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636147712:0@lo:400:kworker.0 00000100:00100000:3.0:1786034498.109953:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034498.109989:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636147712 00000100:00100000:3.0:1786034498.109992:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636147712 00000100:00100000:3.0:1786034498.110040:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786034498.110047:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636147712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034498.110082:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636147712:12345-0@lo:400:kworker.0 Request processed in 36us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034498.110089:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1786034498.110128:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551858380 x1872792636147712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034498.110161:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636147712:0@lo:400:kworker.0 00000100:00080000:3.0:1786034498.110191:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786034498.110210:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455185b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636147456:0@lo:400:kworker.0 00000100:00100000:3.0:1786034498.110235:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034498.110259:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786034498.110265:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636147584:0@lo:400:kworker.0 00000100:00100000:3.0:1786034498.113341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034498.113407:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636147456 00000100:00100000:3.0:1786034498.113414:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636147456 00000100:00100000:3.0:1786034498.113465:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636147584 00000100:00100000:3.0:1786034498.113469:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636147584 00000100:00100000:3.0:1786034498.113496:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1786034498.113504:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636147456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034498.113551:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636147456:12345-0@lo:400:kworker.0 Request processed in 47us (3315us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034498.113558:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1786034498.113574:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1786034498.113580:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636147584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034498.113626:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636147584:12345-0@lo:400:kworker.0 Request processed in 46us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034498.113632:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1786034498.113659:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034498.113685:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636147584:0@lo:400:kworker.0 00000100:00100000:3.0:1786034498.113697:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455185b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636147456:0@lo:400:kworker.0 00000100:00100000:3.0:1786034498.122540:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034498.122564:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455185a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636147840:0@lo:400:kworker.0 00000100:00100000:3.0:1786034498.122628:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034498.122677:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636147840 00000100:00100000:3.0:1786034498.122684:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636147840 00000100:00100000:3.0:1786034498.122732:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1786034498.122740:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636147840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034498.122784:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636147840:12345-0@lo:400:kworker.0 Request processed in 45us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034498.122803:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1786034498.122873:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034498.122902:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455185a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636147840:0@lo:400:kworker.0 00000100:00100000:1.0:1786034498.123540:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636147328:12345-0@lo:400:kworker.0 Request processed in 13727us (13938us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034498.123551:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1786034498.139195:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636147328:0@lo:400:kworker.0 00010000:00010000:1.0:1786034498.224052:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034499.261344:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034500.274214:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034500.445608:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034500.445645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034500.445679:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034500.445700:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034500.445733:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034500.445759:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608847872 00000100:00100000:1.0:1786034500.445768:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608847872 00000100:00100000:1.0:1786034500.445851:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608847744 00000100:00100000:1.0:1786034500.445855:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608847744 00000100:00100000:1.0:1786034500.445882:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 42 00000100:00100000:1.0:1786034500.445891:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964559c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608847872:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034500.445969:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964559c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608847872:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 80us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034500.445976:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 42 00000100:00100000:1.0:1786034500.446115:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 43 00000100:00100000:1.0:1786034500.446120:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551934a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608847744:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034500.446151:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551934a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608847744:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 31us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034500.446156:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 43 00000100:00100000:1.0:1786034500.446172:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608847616 00000100:00100000:1.0:1786034500.446175:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608847616 00000100:00100000:1.0:1786034500.446196:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608847488 00000100:00100000:1.0:1786034500.446217:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608847488 00000100:00100000:1.0:1786034500.446238:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 97 00000100:00100000:1.0:1786034500.446243:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608847616:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034500.446266:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608847616:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 24us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034500.446271:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 97 00000100:00100000:1.0:1786034500.446280:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 98 00000100:00100000:1.0:1786034500.446285:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608847488:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034500.446299:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608847488:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 15us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034500.446304:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 98 00000100:00080000:1.0:1786034500.446319:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786034500.446323:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034500.446325:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786034500.446988:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608847360 00000100:00100000:3.0:1786034500.446993:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608847360 00000100:00100000:0.0:1786034500.447111:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 234 00000100:00100000:0.0:1786034500.447121:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608847360:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034500.447166:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608847360:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 48us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034500.447179:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 234 00000001:02000400:2.0:1786034500.581777:0:10361:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg356-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1786034501.168255:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636147968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034501.168341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034501.168437:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636147968 00000100:00100000:2.0:1786034501.168447:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636147968 00000100:00100000:2.0:1786034501.168515:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786034501.168527:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636147968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786034501.168569:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034501.168641:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636147968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034501.168650:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1786034501.168674:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786034501.168706:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574c81c00 x1872792636147968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034501.168728:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636147968:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786034501.296282:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034502.333480:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034503.216484:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636148096:0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.216573:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034503.216625:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636148608:0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.216655:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034503.216683:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786034503.216689:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636148480:0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.216715:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034503.216746:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636148224:0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.216767:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034503.216784:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636148736:0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.216818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034503.216853:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786034503.216858:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636148352:0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.216881:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034503.216916:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636148096 00000100:00100000:1.0:1786034503.216924:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636148096 00000100:00100000:1.0:1786034503.216981:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1786034503.216991:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636148096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.217049:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636148096:12345-0@lo:400:kworker.0 Request processed in 59us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034503.217057:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1786034503.217092:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636148608 00000100:00100000:1.0:1786034503.217095:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636148608 00000100:00100000:1.0:1786034503.217145:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636148224 00000100:00100000:1.0:1786034503.217148:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636148224 00000100:00100000:1.0:1786034503.217159:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636148352 00000100:00100000:1.0:1786034503.217161:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636148352 00000100:00100000:1.0:1786034503.217175:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1786034503.217181:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636148608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.217212:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636148608:12345-0@lo:400:kworker.0 Request processed in 32us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034503.217218:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1786034503.217241:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1786034503.217247:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636148224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.217273:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636148224:12345-0@lo:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034503.217278:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1786034503.217295:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1786034503.217300:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636148352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.217326:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636148352:12345-0@lo:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034503.217342:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1786034503.217361:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636148480 00000100:00100000:1.0:1786034503.217364:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636148480 00000100:00100000:1.0:1786034503.217388:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636148736 00000100:00100000:1.0:1786034503.217390:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636148736 00000100:00100000:1.0:1786034503.217407:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786034503.217412:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636148480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.217438:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636148480:12345-0@lo:400:kworker.0 Request processed in 26us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034503.217444:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786034503.217453:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1786034503.217458:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636148736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.217477:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636148736:12345-0@lo:400:kworker.0 Request processed in 20us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034503.217482:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1786034503.217511:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786034503.217516:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034503.217518:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034503.217556:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636148352:0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.217565:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636148224:0@lo:400:kworker.0 00010000:00080000:1.0:1786034503.217576:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964542f64700 x1872792636148736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034503.217601:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636148736:0@lo:400:kworker.0 00010000:00080000:1.0:1786034503.217629:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551935500 x1872792636148480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034503.217639:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636148480:0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.217646:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636148096:0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.217655:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636148608:0@lo:400:kworker.0 00000100:00100000:1.0:1786034503.221024:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786034503.221046:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636148864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786034503.221120:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034503.221177:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636148864 00000100:00100000:1.0:1786034503.221185:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636148864 00000100:00100000:1.0:1786034503.221518:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786034503.221532:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636148864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786034503.221573:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034503.221620:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636148864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034503.221628:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1786034503.221669:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964542f64700 x1872792636148864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034503.221688:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636148864:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786034503.353240:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034504.382049:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034505.394385:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034505.572296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034505.572335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034505.572356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034505.572388:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034505.572407:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034505.572429:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608848256 00000100:00100000:1.0:1786034505.572437:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608848256 00000100:00100000:1.0:1786034505.572481:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608848128 00000100:00100000:1.0:1786034505.572484:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608848128 00000100:00100000:1.0:1786034505.572505:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 102 00000100:00100000:1.0:1786034505.572525:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608848256:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034505.572593:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608848256:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 79us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034505.572601:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 102 00000100:00100000:1.0:1786034505.572618:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 103 00000100:00100000:1.0:1786034505.572624:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2364:x1872792608848128:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034505.572649:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2364:x1872792608848128:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 25us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034505.572654:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 103 00000100:00100000:1.0:1786034505.572671:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608848512 00000100:00100000:1.0:1786034505.572674:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608848512 00000100:00100000:1.0:1786034505.572696:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608848384 00000100:00100000:1.0:1786034505.572698:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608848384 00000100:00100000:1.0:1786034505.572715:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 46 00000100:00100000:1.0:1786034505.572721:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608848512:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034505.572745:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608848512:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 24us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034505.572751:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 46 00000100:00100000:1.0:1786034505.572762:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 47 00000100:00100000:1.0:1786034505.572775:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608848384:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034505.572797:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608848384:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 24us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034505.572803:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 47 00000100:00080000:1.0:1786034505.572841:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034505.572845:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786034505.572847:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034505.574126:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608848000 00000100:00100000:2.0:1786034505.574135:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608848000 00000100:00100000:2.0:1786034505.574182:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 236 00000100:00100000:2.0:1786034505.574190:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608848000:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034505.574254:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608848000:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 65us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034505.574262:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 236 00000100:00100000:3.0:1786034506.288623:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636148992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786034506.288716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034506.288954:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636148992 00000100:00100000:2.0:1786034506.288964:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636148992 00000100:00100000:2.0:1786034506.289041:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1786034506.289054:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636148992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786034506.289104:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034506.289153:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636148992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034506.289161:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1786034506.289862:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786034506.290018:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574c81c00 x1872792636148992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034506.290040:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636148992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786034506.419137:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034507.441103:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034508.337044:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636149504:0@lo:400:kworker.0 00000100:00100000:3.0:1786034508.337114:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034508.337163:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786034508.337169:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636149120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034508.337192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034508.337212:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636149632:0@lo:400:kworker.0 00000100:00100000:3.0:1786034508.337233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034508.337261:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636149376:0@lo:400:kworker.0 00000100:00100000:3.0:1786034508.337283:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034508.337312:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636149888:0@lo:400:kworker.0 00000100:00100000:3.0:1786034508.337414:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034508.337436:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786034508.337441:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636149248:0@lo:400:kworker.0 00000100:00100000:3.0:1786034508.337469:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034508.337491:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636149760:0@lo:400:kworker.0 00000100:00100000:3.0:1786034508.337513:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034508.337539:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636149504 00000100:00100000:3.0:1786034508.337546:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636149504 00000100:00100000:3.0:1786034508.337587:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636149376 00000100:00100000:3.0:1786034508.337590:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636149376 00000100:00100000:3.0:1786034508.337600:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636149760 00000100:00100000:3.0:1786034508.337602:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636149760 00000100:00100000:3.0:1786034508.337615:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1786034508.337622:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636149504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034508.337969:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636149504:12345-0@lo:400:kworker.0 Request processed in 346us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034508.337976:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1786034508.337993:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1786034508.338000:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636149376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034508.338414:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636149376:12345-0@lo:400:kworker.0 Request processed in 414us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034508.338422:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1786034508.338436:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1786034508.338443:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636149760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034508.338473:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636149760:12345-0@lo:400:kworker.0 Request processed in 31us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034508.338488:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1786034508.338514:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636149120 00000100:00100000:3.0:1786034508.338518:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636149120 00000100:00100000:3.0:1786034508.338549:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786034508.338555:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636149120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786034508.338581:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034508.338614:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636149120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034508.338620:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786034508.338638:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636149632 00000100:00100000:3.0:1786034508.338642:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636149632 00000100:00100000:3.0:1786034508.338667:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636149888 00000100:00100000:3.0:1786034508.338670:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636149888 00000100:00100000:3.0:1786034508.338686:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786034508.338692:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636149632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034508.338722:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636149632:12345-0@lo:400:kworker.0 Request processed in 31us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034508.338728:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786034508.338738:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1786034508.338745:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636149888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034508.338770:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636149888:12345-0@lo:400:kworker.0 Request processed in 26us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034508.338775:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1786034508.338798:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636149248 00000100:00100000:3.0:1786034508.338802:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636149248 00000100:00100000:3.0:1786034508.338839:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1786034508.338846:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636149248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034508.338882:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636149248:12345-0@lo:400:kworker.0 Request processed in 37us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034508.338889:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:3.0:1786034508.338914:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786034508.338918:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786034508.338920:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1786034508.338955:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964542f64700 x1872792636149120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034508.338972:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636149120:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1786034508.338984:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574d15500 x1872792636149632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034508.338992:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636149632:0@lo:400:kworker.0 00000100:00100000:3.0:1786034508.339003:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636149504:0@lo:400:kworker.0 00000100:00100000:1.0:1786034508.341610:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636149376:0@lo:400:kworker.0 00010000:00080000:1.0:1786034508.341628:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574d15880 x1872792636149888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034508.341638:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636149888:0@lo:400:kworker.0 00000100:00100000:1.0:1786034508.341659:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636149248:0@lo:400:kworker.0 00000100:00100000:1.0:1786034508.341669:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636149760:0@lo:400:kworker.0 00010000:00010000:3.0:1786034508.476864:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034509.489468:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034510.513159:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034510.690292:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034510.690878:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034510.690906:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034510.690931:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034510.691410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034510.692988:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608849024 00000100:00100000:3.0:1786034510.692999:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608849024 00000100:00100000:3.0:1786034510.693062:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608849152 00000100:00100000:3.0:1786034510.693066:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608849152 00000100:00100000:3.0:1786034510.693092:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:3.0:1786034510.693102:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2361:x1872792608849024:12345-192.168.203.56@tcp:9:kworker.0 00000020:00000080:3.0:1786034510.693134:0:6720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fc8a 00000100:00080000:3.0:1786034510.693142:0:6720:0:(import.c:65:import_set_state_nolock()) ffff964548b31800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786034510.693175:0:6720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1786034510.694911:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+2:2361:x1872792608849024:12345-192.168.203.56@tcp:9:kworker.0 Request processed in 1805us (4626us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034510.694921:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:3.0:1786034510.694941:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00100000:3.0:1786034510.694950:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2361:x1872792608849152:12345-192.168.203.56@tcp:9:kworker.0 00000020:00000080:3.0:1786034510.694968:0:6720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fc91 00000100:00080000:3.0:1786034510.694975:0:6720:0:(import.c:65:import_set_state_nolock()) ffff964548b34000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786034510.695001:0:6720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1786034510.695200:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+2:2361:x1872792608849152:12345-192.168.203.56@tcp:9:kworker.0 Request processed in 251us (4321us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034510.695220:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00080000:3.0:1786034510.695240:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786034510.695244:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786034510.695258:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034510.697227:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034510.702462:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608848896 00000100:00100000:1.0:1786034510.702478:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608848896 00000100:00100000:1.0:1786034510.702538:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608848768 00000100:00100000:1.0:1786034510.702542:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608848768 00000100:00100000:1.0:1786034510.702573:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 107 00000100:00100000:1.0:1786034510.702583:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2362:x1872792608848896:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034510.702659:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2362:x1872792608848896:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 77us (11726us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034510.702667:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 107 00000100:00100000:1.0:1786034510.703928:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 108 00000100:00100000:1.0:1786034510.703942:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608848768:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034510.703999:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608848768:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 62us (12590us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034510.704008:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 108 00000100:00100000:1.0:1786034510.704035:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608848640 00000100:00100000:1.0:1786034510.704040:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608848640 00000100:00100000:1.0:1786034510.704083:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 238 00000100:00100000:1.0:1786034510.704090:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608848640:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034510.704114:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608848640:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 25us (13207us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034510.704121:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 238 00000100:00080000:1.0:1786034510.704270:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1786034510.987191:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 46043387-e7a3-40ab-b2ac-2e46aee761ed 00000020:00000080:2.0:1786034510.987200:0:7682:0:(genops.c:906:class_export_put()) final put ffff964548b35000/46043387-e7a3-40ab-b2ac-2e46aee761ed 00000020:00000080:0.0:1786034510.987354:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff964548b35000/46043387-e7a3-40ab-b2ac-2e46aee761ed for lustre-OST0001 00000020:00000080:0.0:1786034510.987405:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff964548b34000 for lustre-OST0001 00000100:00100000:2.0:1786034511.410415:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786034511.410436:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636150016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034511.410495:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034511.410551:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636150016 00000100:00100000:2.0:1786034511.410557:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636150016 00000100:00100000:2.0:1786034511.410607:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786034511.410616:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636150016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786034511.410644:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034511.410684:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636150016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034511.410692:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1786034511.410711:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786034511.410734:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574c83b80 x1872792636150016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034511.411656:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636150016:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786034511.536115:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786034511.997371:0:6746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 46043387-e7a3-40ab-b2ac-2e46aee761ed 00000020:00000080:0.0:1786034511.997381:0:6746:0:(genops.c:906:class_export_put()) final put ffff964548b33000/46043387-e7a3-40ab-b2ac-2e46aee761ed 00000020:00000080:0.0:1786034511.997406:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff964548b33000/46043387-e7a3-40ab-b2ac-2e46aee761ed for lustre-OST0000 00000020:00000080:0.0:1786034511.997446:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff964548b31800 for lustre-OST0000 00010000:00010000:3.0:1786034512.564355:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034513.457452:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455185bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636150528:0@lo:400:kworker.0 00000100:00100000:0.0:1786034513.457516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034513.457569:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786034513.457576:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455185a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636150144:0@lo:400:kworker.0 00000100:00100000:0.0:1786034513.457603:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034513.457626:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455185b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636150656:0@lo:400:kworker.0 00000100:00100000:0.0:1786034513.457650:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034513.457678:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636150528 00000100:00100000:0.0:1786034513.457685:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636150528 00000100:00100000:0.0:1786034513.457739:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1786034513.457748:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636150528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034513.457796:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636150528:12345-0@lo:400:kworker.0 Request processed in 49us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034513.457802:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1786034513.457848:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636150144 00000100:00100000:0.0:1786034513.457852:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636150144 00000100:00100000:0.0:1786034513.457876:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1786034513.457882:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636150144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034513.457922:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636150144:12345-0@lo:400:kworker.0 Request processed in 40us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034513.457929:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:0.0:1786034513.457955:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786034513.457980:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455185a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636150144:0@lo:400:kworker.0 00010000:00080000:0.0:1786034513.457993:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96455185bb80 x1872792636150528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034513.458005:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455185bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636150528:0@lo:400:kworker.0 00000100:00100000:2.0:1786034513.466976:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636150400:0@lo:400:kworker.0 00000100:00100000:2.0:1786034513.467051:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034513.467087:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786034513.467093:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636150272:0@lo:400:kworker.0 00000100:00100000:2.0:1786034513.467112:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034513.467132:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636150784:0@lo:400:kworker.0 00000100:00100000:2.0:1786034513.467150:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034513.467204:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636150784 00000100:00100000:2.0:1786034513.467211:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636150784 00000100:00100000:2.0:1786034513.467263:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786034513.467273:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636150784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034513.467328:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636150784:12345-0@lo:400:kworker.0 Request processed in 57us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034513.467335:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1786034513.467354:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1786034513.467378:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551859180 x1872792636150784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034513.467391:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636150784:0@lo:400:kworker.0 00000100:00100000:0.0:1786034513.467455:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636150656 00000100:00100000:0.0:1786034513.467460:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636150656 00000100:00100000:0.0:1786034513.467496:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636150400 00000100:00100000:0.0:1786034513.467499:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636150400 00000100:00100000:0.0:1786034513.467509:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636150272 00000100:00100000:0.0:1786034513.467511:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636150272 00000100:00100000:0.0:1786034513.467522:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1786034513.467528:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636150656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034513.467564:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636150656:12345-0@lo:400:kworker.0 Request processed in 36us (9912us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034513.467570:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1786034513.467580:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1786034513.467586:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636150400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034513.467608:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636150400:12345-0@lo:400:kworker.0 Request processed in 23us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034513.467614:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1786034513.467622:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1786034513.467627:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636150272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034513.467655:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636150272:12345-0@lo:400:kworker.0 Request processed in 28us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034513.467661:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1786034513.467684:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455185b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636150656:0@lo:400:kworker.0 00000100:00080000:2.0:1786034513.467774:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034513.467791:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636150272:0@lo:400:kworker.0 00000100:00100000:2.0:1786034513.467800:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636150400:0@lo:400:kworker.0 00000100:00100000:0.0:1786034513.470456:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034513.470474:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636150912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034513.470523:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034513.470626:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636150912 00000100:00100000:1.0:1786034513.470632:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636150912 00000100:00100000:1.0:1786034513.470677:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786034513.470686:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636150912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786034513.470718:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034513.470766:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636150912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034513.470773:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1786034513.470915:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964542f64700 x1872792636150912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034513.470931:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636150912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786034513.584009:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034514.608418:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034515.635284:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034515.805164:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034515.805195:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034515.805218:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034515.805251:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608849536 00000100:00100000:3.0:1786034515.805259:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608849536 00000100:00100000:3.0:1786034515.805307:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608849408 00000100:00100000:3.0:1786034515.805309:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608849408 00000100:00100000:3.0:1786034515.805328:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 112 00000100:00100000:3.0:1786034515.805347:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608849536:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034515.805410:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608849536:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 64us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034515.805416:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 112 00000100:00100000:3.0:1786034515.805431:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 113 00000100:00100000:3.0:1786034515.805437:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608849408:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034515.805456:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608849408:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 20us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034515.805462:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 113 00000100:00080000:3.0:1786034515.805489:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034515.807086:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608849280 00000100:00100000:2.0:1786034515.807093:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608849280 00000100:00100000:2.0:1786034515.807136:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 240 00000100:00100000:2.0:1786034515.807143:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608849280:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034515.807187:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608849280:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 45us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034515.807193:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 240 00000100:00100000:2.0:1786034516.528954:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636151040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034516.529027:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034516.529504:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636151040 00000100:00100000:3.0:1786034516.529512:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636151040 00000100:00100000:3.0:1786034516.529573:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1786034516.529583:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636151040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786034516.529613:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034516.529659:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636151040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034516.529667:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1786034516.529718:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574c81500 x1872792636151040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034516.529735:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636151040:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786034516.529784:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786034516.657969:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034517.682235:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034518.586853:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636151552:0@lo:400:kworker.0 00000100:00100000:3.0:1786034518.586920:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034518.586976:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786034518.586983:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636151168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034518.587017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034518.587038:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636151680:0@lo:400:kworker.0 00000100:00100000:3.0:1786034518.587057:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034518.587078:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636151424:0@lo:400:kworker.0 00000100:00100000:3.0:1786034518.587096:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034518.587110:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636151936:0@lo:400:kworker.0 00000100:00100000:3.0:1786034518.587128:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034518.587142:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786034518.587147:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636151296:0@lo:400:kworker.0 00000100:00100000:3.0:1786034518.587173:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034518.587191:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636151808:0@lo:400:kworker.0 00000100:00100000:3.0:1786034518.587211:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034518.587237:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636151552 00000100:00100000:3.0:1786034518.587243:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636151552 00000100:00100000:3.0:1786034518.587289:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636151424 00000100:00100000:3.0:1786034518.587292:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636151424 00000100:00100000:3.0:1786034518.587305:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636151808 00000100:00100000:3.0:1786034518.587307:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636151808 00000100:00100000:3.0:1786034518.587322:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1786034518.587330:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636151552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034518.587376:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636151552:12345-0@lo:400:kworker.0 Request processed in 47us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034518.587382:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1786034518.587396:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1786034518.587401:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636151424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034518.587435:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636151424:12345-0@lo:400:kworker.0 Request processed in 34us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034518.587441:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1786034518.587451:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1786034518.587457:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636151808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034518.587479:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636151808:12345-0@lo:400:kworker.0 Request processed in 23us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034518.587485:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1786034518.587506:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636151168 00000100:00100000:3.0:1786034518.587509:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636151168 00000100:00100000:3.0:1786034518.587536:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786034518.587541:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636151168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786034518.587568:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034518.587597:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636151168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034518.587603:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1786034518.587623:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786034518.587627:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1786034518.587649:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964542f64700 x1872792636151168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034518.587666:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636151168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034518.587677:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636151552:0@lo:400:kworker.0 00000100:00100000:3.0:1786034518.587706:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636151808:0@lo:400:kworker.0 00000100:00100000:3.0:1786034518.587714:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636151424:0@lo:400:kworker.0 00000100:00100000:0.0:1786034518.587862:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636151680 00000100:00100000:0.0:1786034518.587867:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636151680 00000100:00100000:0.0:1786034518.587902:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636151936 00000100:00100000:0.0:1786034518.587905:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636151936 00000100:00100000:0.0:1786034518.587922:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786034518.587928:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636151680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034518.587967:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636151680:12345-0@lo:400:kworker.0 Request processed in 39us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034518.587974:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786034518.587985:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786034518.588002:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636151936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034518.588033:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636151936:12345-0@lo:400:kworker.0 Request processed in 32us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034518.588038:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786034518.588063:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636151296 00000100:00100000:0.0:1786034518.588066:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636151296 00000100:00100000:0.0:1786034518.588086:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1786034518.588091:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636151296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034518.588117:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636151296:12345-0@lo:400:kworker.0 Request processed in 26us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034518.588122:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00010000:00080000:0.0:1786034518.588157:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d65d880 x1872792636151680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034518.588167:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636151680:0@lo:400:kworker.0 00000100:00100000:0.0:1786034518.588187:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636151296:0@lo:400:kworker.0 00010000:00080000:0.0:1786034518.588196:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d65e300 x1872792636151936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034518.588207:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636151936:0@lo:400:kworker.0 00000100:00080000:3.0:1786034518.588497:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786034518.707465:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034519.728017:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034520.753411:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034520.929696:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034520.929740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034520.929798:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034520.929847:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608849792 00000100:00100000:3.0:1786034520.929855:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608849792 00000100:00100000:3.0:1786034520.929902:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608849920 00000100:00100000:3.0:1786034520.929906:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608849920 00000100:00100000:3.0:1786034520.929929:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 117 00000100:00100000:3.0:1786034520.929938:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2364:x1872792608849792:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034520.930012:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2364:x1872792608849792:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 76us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034520.930019:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 117 00000100:00100000:3.0:1786034520.930035:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 118 00000100:00100000:3.0:1786034520.930050:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608849920:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034520.930071:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608849920:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 31us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034520.930076:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 118 00000100:00080000:3.0:1786034520.930100:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034520.933443:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608849664 00000100:00100000:2.0:1786034520.933454:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608849664 00000100:00100000:2.0:1786034520.935389:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 242 00000100:00100000:2.0:1786034520.935406:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608849664:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034520.935499:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608849664:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 98us (5757us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034520.935507:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 242 00000100:00100000:1.0:1786034521.648059:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786034521.648081:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636152064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034521.648145:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034521.649471:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636152064 00000100:00100000:3.0:1786034521.649479:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636152064 00000100:00100000:3.0:1786034521.649529:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786034521.649537:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636152064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786034521.649568:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034521.649614:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636152064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034521.649630:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1786034521.649650:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786034521.649681:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574d15180 x1872792636152064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034521.649698:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636152064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786034521.776008:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034522.801019:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034523.696049:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636152192:0@lo:400:kworker.0 00000100:00100000:3.0:1786034523.696119:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034523.696281:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636152320:0@lo:400:kworker.0 00000100:00100000:1.0:1786034523.696314:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034523.696346:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636152320 00000100:00100000:1.0:1786034523.696360:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636152320 00000100:00100000:1.0:1786034523.696408:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1786034523.696416:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636152320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034523.696464:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636152320:12345-0@lo:400:kworker.0 Request processed in 49us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034523.696472:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1786034523.696546:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636152576:0@lo:400:kworker.0 00000100:00100000:0.0:1786034523.696579:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034523.696612:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636152448:0@lo:400:kworker.0 00000100:00100000:1.0:1786034523.696695:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636152576 00000100:00100000:1.0:1786034523.696699:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636152576 00000100:00100000:1.0:1786034523.696736:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786034523.696743:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636152576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034523.696779:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636152576:12345-0@lo:400:kworker.0 Request processed in 37us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034523.696785:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1786034523.696799:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786034523.697279:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636152704:0@lo:400:kworker.0 00000100:00100000:3.0:1786034523.697308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034523.697332:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636152704 00000100:00100000:3.0:1786034523.697336:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636152704 00000100:00100000:3.0:1786034523.697367:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1786034523.697374:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636152704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034523.697409:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636152704:12345-0@lo:400:kworker.0 Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034523.697415:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1786034523.697432:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034523.697716:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034523.697748:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636152192 00000100:00100000:0.0:1786034523.697752:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636152192 00000100:00100000:0.0:1786034523.697776:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1786034523.697782:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636152192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034523.697813:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636152192:12345-0@lo:400:kworker.0 Request processed in 31us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034523.697847:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1786034523.697875:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636152448 00000100:00100000:0.0:1786034523.697879:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636152448 00000100:00100000:0.0:1786034523.697903:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1786034523.697909:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636152448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034523.697942:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636152448:12345-0@lo:400:kworker.0 Request processed in 33us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034523.697959:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1786034523.699555:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636152320:0@lo:400:kworker.0 00000100:00100000:2.0:1786034523.699565:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636152832:0@lo:400:kworker.0 00000100:00100000:2.0:1786034523.699599:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786034523.699718:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034523.699743:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636152704:0@lo:400:kworker.0 00000100:00100000:0.0:1786034523.699795:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636152832 00000100:00100000:0.0:1786034523.699800:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636152832 00000100:00100000:0.0:1786034523.699851:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786034523.699859:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636152832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034523.699895:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636152832:12345-0@lo:400:kworker.0 Request processed in 38us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034523.699902:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1786034523.699935:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d65ea00 x1872792636152576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034523.699956:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636152576:0@lo:400:kworker.0 00010000:00080000:2.0:1786034523.701881:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d65c700 x1872792636152832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034523.701892:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636152832:0@lo:400:kworker.0 00000100:00100000:1.0:1786034523.702058:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636152448:0@lo:400:kworker.0 00000100:00100000:1.0:1786034523.702068:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636152960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786034523.702100:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034523.704310:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636152192:0@lo:400:kworker.0 00000100:00080000:3.0:1786034523.704334:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786034523.711750:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636152960 00000100:00100000:0.0:1786034523.711763:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636152960 00000100:00100000:0.0:1786034523.711838:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786034523.711849:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636152960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786034523.711885:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034523.711965:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636152960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (9864us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034523.711983:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1786034523.714655:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96455a5b3800 x1872792636152960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034523.714676:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636152960:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1786034523.782493:0:11066:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1786034523.832529:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034524.858867:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034525.873705:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034526.049264:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034526.049410:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034526.049432:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034526.049467:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608850176 00000100:00100000:1.0:1786034526.049476:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608850176 00000100:00100000:1.0:1786034526.049519:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608850304 00000100:00100000:1.0:1786034526.049527:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608850304 00000100:00100000:1.0:1786034526.049549:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 122 00000100:00100000:1.0:1786034526.049557:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2365:x1872792608850176:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034526.049617:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2365:x1872792608850176:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 61us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034526.049624:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 122 00000100:00100000:1.0:1786034526.049640:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 123 00000100:00100000:1.0:1786034526.049645:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2365:x1872792608850304:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034526.049662:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2365:x1872792608850304:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 18us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034526.049668:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 123 00000100:00080000:1.0:1786034526.049680:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034526.049998:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608850048 00000100:00100000:2.0:1786034526.050004:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608850048 00000100:00100000:2.0:1786034526.050038:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 244 00000100:00100000:2.0:1786034526.050045:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2365:x1872792608850048:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034526.050082:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2365:x1872792608850048:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 36us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034526.050098:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 244 00000100:00100000:0.0:1786034526.768105:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636153088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786034526.768181:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034526.768371:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636153088 00000100:00100000:3.0:1786034526.768378:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636153088 00000100:00100000:3.0:1786034526.768476:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1786034526.768486:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636153088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786034526.768519:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034526.768565:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636153088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034526.768573:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1786034526.771857:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d65d880 x1872792636153088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034526.771882:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636153088:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786034526.773434:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786034526.920947:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034527.920056:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786034528.669773:0:11214:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed2e9fb50 20000000:00000080:3.0:1786034528.669793:0:11214:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff964577703000 uarg=0000000000000000 20000000:01000000:3.0:1786034528.669905:0:11214:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1786034528.669921:0:11214:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1786034528.669927:0:11214:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1786034528.670650:0:11215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1786034528.670903:0:11214:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1786034528.681336:0:11214:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1786034528.683732:0:11214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.683757:0:11214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964582167200/0x490975051af3fc44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fc3d expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.683784:0:11214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964562312200/0x490975051af3fc52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fc4b expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.683791:0:11214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9645413f0800/0x490975051af3fc60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fc59 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.683801:0:11214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9645413f1c00/0x490975051af3fc67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75855c expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.683808:0:11214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964582167800/0x490975051af3fc7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758594 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.683815:0:11214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.684052:0:11214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964582167800/0x490975051af3fc7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758594 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.684069:0:11214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964582167800/0x490975051af3fc7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758594 expref: 12 pid: 5856 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034528.684089:0:11214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11214:1872792636153216:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034528.684298:0:11214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9645413f1c00/0x490975051af3fc67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75855c expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.684307:0:11214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9645413f1c00/0x490975051af3fc67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75855c expref: 12 pid: 5856 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034528.684316:0:11214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c82d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11214:1872792636153344:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034528.684354:0:11214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9645413f0800/0x490975051af3fc60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fc59 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.684363:0:11214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9645413f0800/0x490975051af3fc60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fc59 expref: 18 pid: 5856 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034528.684373:0:11214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c82a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11214:1872792636153472:0@lo:104: 00000100:00100000:2.0:1786034528.684417:0:11214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786034528.684464:0:11214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964562312200/0x490975051af3fc52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fc4b expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.684472:0:11214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964562312200/0x490975051af3fc52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fc4b expref: 18 pid: 5853 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034528.684479:0:11214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c83100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11214:1872792636153600:0@lo:104: 00000100:00100000:2.0:1786034528.684498:0:11214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786034528.684521:0:11214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964582167200/0x490975051af3fc44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fc3d expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.684528:0:11214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964582167200/0x490975051af3fc44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fc3d expref: 18 pid: 5853 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034528.684535:0:11214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c81c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11214:1872792636153728:0@lo:104: 00000100:00100000:2.0:1786034528.684550:0:11214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034528.684559:0:11214:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645593f53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034528.685684:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636153472 00000100:00100000:0.0:1786034528.685693:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636153472 00000100:00100000:0.0:1786034528.685740:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636153600 00000100:00100000:0.0:1786034528.685743:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636153600 00000100:00100000:0.0:1786034528.685754:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636153728 00000100:00100000:0.0:1786034528.685756:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636153728 00000100:00100000:0.0:1786034528.685771:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786034528.685781:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+5:11214:x1872792636153472:12345-0@lo:104: 00010000:00010000:0.0:1786034528.685795:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fc60 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.685877:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786034528.685882:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+5:11214:x1872792636153472:12345-0@lo:104: Request processed in 103us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034528.685889:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786034528.685906:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786034528.685921:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+4:11214:x1872792636153600:12345-0@lo:104: 00010000:00010000:0.0:1786034528.685928:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fc52 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.685957:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1786034528.685968:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+4:11214:x1872792636153600:12345-0@lo:104: Request processed in 48us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034528.685974:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786034528.685984:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786034528.685989:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:11214:x1872792636153728:12345-0@lo:104: 00010000:00010000:0.0:1786034528.685996:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fc44 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686024:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1786034528.686028:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:11214:x1872792636153728:12345-0@lo:104: Request processed in 40us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034528.686033:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1786034528.686048:0:7670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786034528.686054:0:7670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fc60 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686061:0:7670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01c00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034528.686064:0:7670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fc60 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686073:0:7670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fc60 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034528.686079:0:7670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fc60 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034528.686083:0:7670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786034528.686110:0:7670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fc60 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686137:0:7670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034528.686159:0:7670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fc60 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686167:0:7670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af3fc59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fc60 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686178:0:7670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786034528.686180:0:7670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fc52 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686185:0:7670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00800 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034528.686188:0:7670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fc52 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686193:0:7670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fc52 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034528.686198:0:7670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fc52 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034528.686203:0:7670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786034528.686214:0:7670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fc52 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686220:0:7670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034528.686234:0:7670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fc52 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686240:0:7670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af3fc4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fc52 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686252:0:7670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034528.686255:0:7670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fc44 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686260:0:7670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00c00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034528.686263:0:7670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fc44 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686268:0:7670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fc44 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034528.686274:0:7670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fc44 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034528.686279:0:7670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786034528.686288:0:7670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fc44 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686294:0:7670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034528.686299:0:7670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fc44 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686305:0:7670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964574d00c00/0x490975051af3fc3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fc44 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686315:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034528.686317:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034528.686319:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034528.686325:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034528.686336:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034528.686348:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636153856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034528.686381:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034528.686422:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636153984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034528.686446:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034528.686464:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034528.686470:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636154112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034528.686489:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034528.686515:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636153856 00000100:00100000:0.0:1786034528.686518:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636153856 00010000:00010000:0.0:1786034528.686536:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9645413f0800/0x490975051af3fc60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fc59 expref: 19 pid: 5856 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034528.686556:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636153984 00000100:00100000:0.0:1786034528.686559:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636153984 00010000:00010000:0.0:1786034528.686571:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964562312200/0x490975051af3fc52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fc4b expref: 20 pid: 5853 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034528.686580:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636154112 00000100:00100000:0.0:1786034528.686582:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636154112 00010000:00010000:0.0:1786034528.686590:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964582167200/0x490975051af3fc44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fc3d expref: 21 pid: 5853 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034528.686762:0:11214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c82a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11214:1872792636153472:0@lo:104: 00000100:00100000:2.0:1786034528.686772:0:11214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c83100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11214:1872792636153600:0@lo:104: 00000100:00100000:2.0:1786034528.686779:0:11214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c81c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11214:1872792636153728:0@lo:104: 00000100:00100000:0.0:1786034528.686815:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786034528.686847:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a060450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+21:3308:x1872792636153856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786034528.686860:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034528.686866:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9645413f0800/0x490975051af3fc60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fc59 expref: 21 pid: 5856 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686885:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9645413f0800/0x490975051af3fc60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fc59 expref: 21 pid: 5856 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686900:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f0800/0x490975051af3fc60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fc59 expref: 21 pid: 5856 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.686923:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034528.686954:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a060450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+20:3308:x1872792636153856:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034528.686961:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786034528.687002:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786034528.687008:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636153984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786034528.687015:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034528.687020:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964562312200/0x490975051af3fc52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fc4b expref: 19 pid: 5853 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.687028:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964562312200/0x490975051af3fc52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fc4b expref: 19 pid: 5853 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.687037:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964562312200/0x490975051af3fc52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fc4b expref: 19 pid: 5853 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.687046:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034528.687066:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:3309:x1872792636153984:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034528.687072:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786034528.687084:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786034528.687090:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551859500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:3309:x1872792636154112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786034528.687103:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034528.687108:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964582167200/0x490975051af3fc44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fc3d expref: 17 pid: 5853 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.687116:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964582167200/0x490975051af3fc44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fc3d expref: 17 pid: 5853 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034528.687262:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636153856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786034528.687304:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964582167200/0x490975051af3fc44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fc3d expref: 17 pid: 5853 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.687314:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034528.687336:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551859500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3309:x1872792636154112:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034528.687342:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786034528.687376:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636154112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034528.687383:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636153984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034528.706743:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034528.706787:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034528.706925:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608850432 00000100:00100000:0.0:1786034528.706937:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608850432 00010000:00010000:0.0:1786034528.706982:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964582167800/0x490975051af3fc7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758594 expref: 13 pid: 5856 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034528.707015:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608850560 00000100:00100000:0.0:1786034528.707018:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608850560 00010000:00010000:0.0:1786034528.707030:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9645413f1c00/0x490975051af3fc67 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75855c expref: 14 pid: 5856 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034528.707066:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 28 00000100:00100000:0.0:1786034528.707077:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c13892d0-993e-46f4-852e-b7a576d2b5bb+14:2362:x1872792608850432:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034528.707116:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034528.707123:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964582167800/0x490975051af3fc7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758594 expref: 14 pid: 5856 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.707147:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964582167800/0x490975051af3fc7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758594 expref: 14 pid: 5856 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.707169:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034528.707228:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c13892d0-993e-46f4-852e-b7a576d2b5bb+14:2362:x1872792608850432:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 154us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034528.707236:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 28 00000100:00100000:0.0:1786034528.707255:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 29 00000100:00100000:0.0:1786034528.707261:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608850560:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034528.707268:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034528.707272:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9645413f1c00/0x490975051af3fc67 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75855c expref: 13 pid: 5856 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.707281:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9645413f1c00/0x490975051af3fc67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75855c expref: 13 pid: 5856 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.707294:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.707303:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.707319:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.707335:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.707342:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.707359:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.707366:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0200 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034528.707371:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.707380:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.707389:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034528.707400:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034528.707420:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608850560:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 158us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034528.707426:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 29 00010000:00010000:2.0:1786034528.708036:0:11214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964582167800/0x490975051af3fc7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758594 expref: 12 pid: 5856 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034528.708052:0:11214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11214:1872792636153216:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034528.708065:0:11214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f1c00/0x490975051af3fc67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75855c expref: 11 pid: 5856 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034528.708075:0:11214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c82d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11214:1872792636153344:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034528.708110:0:11214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.708119:0:11214:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.708135:0:11214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034528.708142:0:11214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f0200/0x490975051af3fc98 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034528.816050:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636154240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034528.816139:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034528.816296:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636154240 00000100:00100000:1.0:1786034528.816305:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636154240 00000100:00100000:1.0:1786034528.816373:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786034528.816382:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636154240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786034528.816421:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034528.816465:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636154240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034528.816471:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786034528.816819:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636154496:0@lo:400:kworker.0 00000100:00100000:1.0:1786034528.816866:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034528.816884:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786034528.816890:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636154624:0@lo:400:kworker.0 00000100:00100000:1.0:1786034528.816938:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034528.816963:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636154496 00000100:00100000:1.0:1786034528.816967:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636154496 00000100:00100000:1.0:1786034528.816992:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636154624 00000100:00100000:1.0:1786034528.816994:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636154624 00000100:00100000:1.0:1786034528.817012:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1786034528.817017:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636154496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034528.817049:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636154496:12345-0@lo:400:kworker.0 Request processed in 32us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034528.817054:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1786034528.817064:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1786034528.817069:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636154624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034528.817089:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636154624:12345-0@lo:400:kworker.0 Request processed in 21us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034528.817094:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1786034528.817140:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636154624:0@lo:400:kworker.0 00000100:00100000:1.0:1786034528.817149:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636154496:0@lo:400:kworker.0 00000100:00080000:2.0:1786034528.818253:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786034528.818259:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786034528.818409:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636154368:0@lo:400:kworker.0 00000100:00100000:2.0:1786034528.818453:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034528.818492:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636154880:0@lo:400:kworker.0 00000100:00100000:2.0:1786034528.818513:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034528.824310:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786034528.824333:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636154752:0@lo:400:kworker.0 00000100:00100000:2.0:1786034528.824405:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034528.824459:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636154880 00000100:00100000:2.0:1786034528.824468:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636154880 00000100:00100000:2.0:1786034528.824551:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1786034528.824562:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636154880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034528.824626:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636154880:12345-0@lo:400:kworker.0 Request processed in 66us (6110us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034528.824633:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1786034528.824658:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636154752 00000100:00100000:2.0:1786034528.824662:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636154752 00000100:00100000:2.0:1786034528.824691:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1786034528.824698:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636154752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034528.824729:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636154752:12345-0@lo:400:kworker.0 Request processed in 32us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034528.824736:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1786034528.824752:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786034528.824758:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1786034528.824799:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb4000 x1872792636154240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034528.824836:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636154240:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1786034528.824867:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574eb7800 x1872792636154752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034528.824874:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636154752:0@lo:400:kworker.0 00000100:00100000:2.0:1786034528.824883:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636154880:0@lo:400:kworker.0 00000100:00100000:3.0:1786034528.825105:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636154368 00000100:00100000:3.0:1786034528.825110:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636154368 00000100:00100000:3.0:1786034528.825207:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1786034528.825215:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3308:x1872792636154368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034528.825255:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3308:x1872792636154368:12345-0@lo:400:kworker.0 Request processed in 42us (6802us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034528.825262:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1786034528.825304:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636154368:0@lo:400:kworker.0 00010000:00010000:3.0:1786034528.945866:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034529.971569:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786034530.353087:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786034530.353096:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96457642c000 from 7 10000000:01000000:0.0:1786034530.353102:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786034530.353223:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034530.353238:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034530.353261:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034530.353292:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786034530.353367:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034530.353430:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034530.353545:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636155008 00000100:00100000:1.0:1786034530.353553:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636155008 00000100:00100000:1.0:1786034530.353619:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1786034530.353630:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636155008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786034530.353645:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034530.353661:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964574d01600/0x490975051af3fca6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fc9f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034530.353687:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d01600/0x490975051af3fca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fc9f expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034530.353707:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964574d01600/0x490975051af3fca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fc9f expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034530.353717:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01600, rc 0) 00000100:00100000:1.0:1786034530.353768:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636155008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034530.353776:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1786034530.354283:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786034530.354299:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fca6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034530.354309:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fca6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034530.354367:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034530.354393:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034530.354410:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034530.354460:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636155136 00000100:00100000:3.0:1786034530.354465:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636155136 00000100:00100000:3.0:1786034530.354499:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1786034530.354514:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636155136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034530.354794:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636155136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034530.354800:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1786034530.354923:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034530.354950:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034530.354984:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034530.354997:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034530.355036:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636155264 00000100:00100000:3.0:1786034530.355040:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636155264 00000100:00100000:3.0:1786034530.355063:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1786034530.355068:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636155264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034530.355277:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636155264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034530.355283:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1786034530.355349:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786034530.356644:0:11245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1786034530.357316:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1786034530.357336:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786034530.357348:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fca6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034530.357360:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fca6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034530.357371:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786034530.357373:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff964548917000 from 7 10000000:01000000:1.0:1786034530.357376:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786034530.357412:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034530.357420:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034530.357431:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034530.357453:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786034530.357516:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034530.357553:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964549eb1480 going to sleep for 11 seconds 00000100:00100000:0.0:1786034530.358219:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636155392 00000100:00100000:0.0:1786034530.358227:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636155392 00000100:00100000:0.0:1786034530.358271:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1786034530.358278:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636155392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786034530.358293:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034530.358306:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df9200/0x490975051af3fcb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fcad expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034530.358327:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df9200/0x490975051af3fcb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fcad expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034530.358337:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df9200/0x490975051af3fcb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fcad expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034530.358346:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9200, rc 0) 00000100:00100000:0.0:1786034530.358388:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636155392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034530.358393:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1786034530.358508:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786034530.358521:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fcb4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034530.358530:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fcb4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034530.358581:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786034530.358603:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034530.358671:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964549eb1480 going to sleep for 11 seconds 00000100:00100000:2.0:1786034530.360417:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636155520 00000100:00100000:2.0:1786034530.360427:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636155520 00000100:00100000:2.0:1786034530.360498:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1786034530.360507:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636155520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034530.360799:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636155520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034530.360807:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1786034530.360904:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786034530.360956:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786034530.360995:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034530.366643:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964549eb1480 going to sleep for 11 seconds 00000100:00100000:0.0:1786034530.370927:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636155648 00000100:00100000:0.0:1786034530.370942:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636155648 00000100:00100000:1.0:1786034530.371083:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1786034530.371093:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636155648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786034530.371402:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636155648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 310us (10406us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034530.371411:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1786034530.371564:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786034530.373044:0:11246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1786034530.374210:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1786034530.374240:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786034530.374254:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fcb4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034530.374266:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fcb4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786034530.374278:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786034530.374280:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff964559843800 from 7 10000000:01000000:2.0:1786034530.374283:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786034530.374325:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034530.374332:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034530.374344:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034530.374370:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786034530.374454:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034530.374498:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454afa5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786034530.374574:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636155776 00000100:00100000:1.0:1786034530.374583:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636155776 00000100:00100000:1.0:1786034530.374624:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1786034530.374633:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636155776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786034530.374656:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034530.374670:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964574d00000/0x490975051af3fcc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fcbb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034530.374695:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d00000/0x490975051af3fcc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fcbb expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034530.374707:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964574d00000/0x490975051af3fcc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fcbb expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034530.374716:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00000, rc 0) 00000100:00100000:1.0:1786034530.374763:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636155776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034530.374770:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1786034530.374869:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786034530.374885:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fcc2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034530.374904:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fcc2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034530.374956:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034530.374989:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034530.375008:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034530.375054:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636155904 00000100:00100000:2.0:1786034530.375058:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636155904 00000100:00100000:2.0:1786034530.375079:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1786034530.375086:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636155904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034530.376211:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636155904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1122us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034530.376220:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1786034530.378991:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636155904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034530.379063:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636156032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034530.379203:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034530.379285:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645538d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1786034530.380349:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636156032 00000100:00100000:1.0:1786034530.380357:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636156032 00000100:00100000:1.0:1786034530.380444:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1786034530.380454:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636156032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786034530.380672:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636156032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034530.380680:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1786034530.380757:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636156032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786034530.387736:0:11247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1786034530.391004:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1786034530.391043:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786034530.391057:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fcc2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034530.391071:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fcc2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034530.462112:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034530.462179:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608850688 00000100:00100000:3.0:1786034530.462190:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608850688 00000100:00100000:3.0:1786034530.462262:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 255 00000100:00100000:3.0:1786034530.462271:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+11:5613:x1872792608850688:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034530.462290:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034530.462309:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964562313c00/0x490975051af3fcc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7585be expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034530.462340:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964562313c00/0x490975051af3fcc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585be expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034530.462351:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964562313c00/0x490975051af3fcc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585be expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034530.462359:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562313c00, rc 0) 00000100:00100000:3.0:1786034530.462416:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:5613:x1872792608850688:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 Request processed in 147us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034530.462422:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 255 00000100:00100000:0.0:1786034530.468706:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034530.469232:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608850816 00000100:00100000:1.0:1786034530.469243:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608850816 00000100:00100000:1.0:1786034530.469301:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 256 00000100:00100000:1.0:1786034530.469310:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:5613:x1872792608850816:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786034530.469626:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:5613:x1872792608850816:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 Request processed in 317us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034530.469640:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 256 00000100:00100000:1.0:1786034530.471086:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034530.471143:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608850944 00000100:00100000:3.0:1786034530.471150:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608850944 00000100:00100000:3.0:1786034530.471222:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 257 00000100:00100000:3.0:1786034530.471231:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:5613:x1872792608850944:12345-192.168.203.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034530.471417:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:5613:x1872792608850944:12345-192.168.203.56@tcp:503:ll_cfg_requeue.0 Request processed in 187us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034530.471425:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 257 00000100:00100000:2.0:1786034530.480001:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034530.480097:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608851072 00000100:00100000:0.0:1786034530.480109:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608851072 00000100:00100000:0.0:1786034530.481996:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 258 00000100:00100000:0.0:1786034530.482013:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:5613:x1872792608851072:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786034530.482035:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034530.482060:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df9800/0x490975051af3fcd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7585c5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034530.482093:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df9800/0x490975051af3fcd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585c5 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034530.482106:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df9800/0x490975051af3fcd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585c5 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034530.482116:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9800, rc 0) 00000100:00100000:0.0:1786034530.482186:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:5613:x1872792608851072:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 Request processed in 179us (2196us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034530.482194:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 258 00000100:00100000:0.0:1786034530.494667:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034530.494734:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608851200 00000100:00100000:1.0:1786034530.494746:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608851200 00000100:00100000:1.0:1786034530.494805:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 259 00000100:00100000:1.0:1786034530.494815:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:5613:x1872792608851200:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786034530.495319:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:5613:x1872792608851200:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 Request processed in 503us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034530.495328:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 259 00000100:00100000:2.0:1786034530.501747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034530.501819:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608851328 00000100:00100000:0.0:1786034530.501856:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608851328 00000100:00100000:0.0:1786034530.501922:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 260 00000100:00100000:0.0:1786034530.501932:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:5613:x1872792608851328:12345-192.168.203.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034530.502178:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:5613:x1872792608851328:12345-192.168.203.56@tcp:503:ll_cfg_requeue.0 Request processed in 246us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034530.502193:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 260 00010000:00010000:0.0:1786034530.995635:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034531.169207:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034531.169305:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608851584 00000100:00100000:2.0:1786034531.169314:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608851584 00000100:00100000:2.0:1786034531.169365:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 127 00000100:00100000:2.0:1786034531.169380:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2364:x1872792608851584:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034531.169557:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2364:x1872792608851584:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 182us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034531.169565:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 127 00000100:00080000:2.0:1786034531.169585:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034531.173269:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034531.175009:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034531.175065:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608851712 00000100:00100000:3.0:1786034531.175091:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608851712 00000100:00100000:3.0:1786034531.175708:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 128 00000100:00100000:3.0:1786034531.175720:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608851712:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034531.175808:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608851712:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 91us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034531.175817:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 128 00000100:00080000:3.0:1786034531.175882:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034531.181109:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608851456 00000100:00100000:0.0:1786034531.181122:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608851456 00000100:00100000:0.0:1786034531.186043:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 261 00000100:00100000:0.0:1786034531.186061:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608851456:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034531.186133:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608851456:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 79us (12878us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034531.186141:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 261 00000100:00100000:1.0:1786034531.891803:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636156160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034531.891926:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034531.892038:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636156160 00000100:00100000:1.0:1786034531.892047:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636156160 00000100:00100000:1.0:1786034531.892111:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786034531.892119:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636156160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786034531.892163:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034531.892208:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636156160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034531.892215:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1786034531.892237:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786034531.892271:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551859f80 x1872792636156160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034531.892292:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636156160:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786034532.021215:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034533.041482:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034533.935949:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786034533.935971:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636156288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034533.936035:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034533.936121:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636156288 00000100:00100000:2.0:1786034533.936128:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636156288 00000100:00100000:2.0:1786034533.936185:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1786034533.936204:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636156288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034533.936238:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034533.936282:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636156288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034533.936289:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1786034533.936309:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1786034533.936351:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574c82a00 x1872792636156288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034533.936369:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636156288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034533.937254:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636156544:0@lo:400:kworker.0 00000100:00100000:2.0:1786034533.937287:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034533.937310:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1786034533.937316:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636156416:0@lo:400:kworker.0 00000100:00100000:2.0:1786034533.938283:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034533.938314:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636156928:0@lo:400:kworker.0 00000100:00100000:0.0:1786034533.938472:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636156800:0@lo:400:kworker.0 00000100:00100000:3.0:1786034533.939316:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636156544 00000100:00100000:3.0:1786034533.939333:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636156544 00000100:00100000:3.0:1786034533.939377:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1786034533.939386:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636156544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034533.946490:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034533.946536:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786034533.947522:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034533.947590:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636156416 00000100:00100000:2.0:1786034533.947598:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636156416 00000100:00100000:2.0:1786034533.947639:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1786034533.947658:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636156416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034533.947709:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636156416:12345-0@lo:400:kworker.0 Request processed in 52us (9426us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034533.947715:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1786034533.947742:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636156928 00000100:00100000:2.0:1786034533.947745:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636156928 00000100:00100000:2.0:1786034533.947780:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1786034533.947785:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636156928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034533.947813:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636156928:12345-0@lo:400:kworker.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034533.947818:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1786034533.947880:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034533.947904:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636156416:0@lo:400:kworker.0 00000100:00100000:2.0:1786034533.947915:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636156928:0@lo:400:kworker.0 00000100:00100000:0.0:1786034533.948072:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636156672:0@lo:400:kworker.0 00000100:00100000:0.0:1786034533.948103:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034533.948180:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636156800 00000100:00100000:0.0:1786034533.948184:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636156800 00000100:00100000:0.0:1786034533.948219:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1786034533.948226:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636156800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034533.948262:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636156800:12345-0@lo:400:kworker.0 Request processed in 37us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034533.948268:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1786034533.948286:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1786034533.948305:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574c97480 x1872792636156800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034533.948317:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636156800:0@lo:400:kworker.0 00000100:00100000:3.0:1786034533.948498:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636156544:12345-0@lo:400:kworker.0 Request processed in 9113us (11210us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034533.948506:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1786034533.948520:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636156672 00000100:00100000:3.0:1786034533.948524:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636156672 00000100:00100000:3.0:1786034533.948561:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1786034533.948567:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636156672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034533.948599:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636156672:12345-0@lo:400:kworker.0 Request processed in 32us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034533.948605:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1786034533.950725:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636156544:0@lo:400:kworker.0 00000100:00080000:0.0:1786034533.951393:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034533.951416:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636156672:0@lo:400:kworker.0 00010000:00010000:2.0:1786034534.065395:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786034534.265807:0:11412:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1786034535.092190:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034536.114633:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034536.297001:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034536.297048:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034536.297069:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034536.297098:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608852096 00000100:00100000:1.0:1786034536.297105:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608852096 00000100:00100000:1.0:1786034536.297158:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608851968 00000100:00100000:1.0:1786034536.297160:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608851968 00000100:00100000:1.0:1786034536.297181:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 132 00000100:00100000:1.0:1786034536.297189:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608852096:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034536.297255:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608852096:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034536.297263:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 132 00000100:00100000:1.0:1786034536.297280:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 133 00000100:00100000:1.0:1786034536.297286:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2364:x1872792608851968:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034536.297310:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2364:x1872792608851968:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 24us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034536.297316:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 133 00000100:00080000:1.0:1786034536.297331:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034536.297481:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608851840 00000100:00100000:3.0:1786034536.297485:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608851840 00000100:00100000:3.0:1786034536.297519:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 263 00000100:00100000:3.0:1786034536.297526:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608851840:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034536.297618:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608851840:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 93us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034536.297639:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 263 00000100:00100000:3.0:1786034537.014119:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636157056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786034537.014181:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034537.014247:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636157056 00000100:00100000:3.0:1786034537.014254:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636157056 00000100:00100000:3.0:1786034537.014302:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786034537.014311:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636157056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786034537.014341:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034537.014382:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636157056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034537.014389:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1786034537.014407:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786034537.014434:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d65e300 x1872792636157056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034537.014452:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636157056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786034537.136237:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034538.162708:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786034539.004506:0:11511:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:42:16 (1786034536) === 00000100:00100000:0.0:1786034539.062386:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636157312:0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.062472:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034539.062525:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636157824:0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.062550:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034539.062583:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786034539.062588:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636157184:0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.062628:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034539.062649:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636157696:0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.062669:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034539.062691:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636157440:0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.062711:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034539.062728:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786034539.062732:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636157568:0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.062750:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034539.062780:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636157824 00000100:00100000:0.0:1786034539.062788:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636157824 00000100:00100000:0.0:1786034539.062883:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636157568 00000100:00100000:0.0:1786034539.062886:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636157568 00000100:00100000:0.0:1786034539.062909:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786034539.062920:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636157824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.062974:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636157824:12345-0@lo:400:kworker.0 Request processed in 57us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034539.062996:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786034539.063015:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786034539.063022:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636157568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.063054:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636157568:12345-0@lo:400:kworker.0 Request processed in 33us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034539.063060:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786034539.063076:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636157184 00000100:00100000:0.0:1786034539.063079:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636157184 00000100:00100000:0.0:1786034539.063104:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1786034539.063110:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636157184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.063136:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636157184:12345-0@lo:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034539.063142:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1786034539.063168:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636157312 00000100:00100000:0.0:1786034539.063171:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636157312 00000100:00100000:0.0:1786034539.063193:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636157696 00000100:00100000:0.0:1786034539.063196:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636157696 00000100:00100000:0.0:1786034539.063207:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636157440 00000100:00100000:0.0:1786034539.063209:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636157440 00000100:00100000:0.0:1786034539.063221:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1786034539.063227:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636157312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.063253:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636157312:12345-0@lo:400:kworker.0 Request processed in 26us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034539.063257:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1786034539.063266:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1786034539.063271:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636157696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.063303:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636157696:12345-0@lo:400:kworker.0 Request processed in 32us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034539.063308:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1786034539.063318:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1786034539.063323:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636157440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.063343:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636157440:12345-0@lo:400:kworker.0 Request processed in 21us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034539.063348:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1786034539.063366:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786034539.063371:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786034539.063373:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1786034539.063416:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551858000 x1872792636157568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034539.063432:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636157568:0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.063444:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636157440:0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.063472:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636157184:0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.063481:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636157696:0@lo:400:kworker.0 00000100:00100000:0.0:1786034539.063490:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636157312:0@lo:400:kworker.0 00010000:00080000:0.0:1786034539.063501:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551859180 x1872792636157824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034539.063508:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636157824:0@lo:400:kworker.0 00000100:00100000:1.0:1786034539.067057:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636157952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786034539.067136:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034539.069415:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636157952 00000100:00100000:3.0:1786034539.069426:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636157952 00000100:00100000:3.0:1786034539.069494:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786034539.069504:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636157952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786034539.069549:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034539.069633:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636157952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (2496us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034539.069641:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1786034539.070407:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d65e300 x1872792636157952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034539.070445:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636157952:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786034539.185695:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034539.395577:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034539.395623:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034539.395718:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608852224 00000100:00100000:0.0:1786034539.395730:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608852224 00000100:00100000:0.0:1786034539.395814:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:0.0:1786034539.395865:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608852224:12345-192.168.203.56@tcp:41:mkdir.0 00000004:00000024:0.0:1786034539.395918:0:6743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1786034539.396011:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608852224:12345-192.168.203.56@tcp:41:mkdir.0 Request processed in 188us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034539.396019:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00080000:3.0:1786034539.396538:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034539.399484:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608852352 00000100:00100000:2.0:1786034539.399502:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608852352 00000100:00100000:2.0:1786034539.399575:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:2.0:1786034539.399587:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:9700:x1872792608852352:12345-192.168.203.56@tcp:700:mkdir.0 00000100:00100000:2.0:1786034539.399684:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:9700:x1872792608852352:12345-192.168.203.56@tcp:700:mkdir.0 Request processed in 99us (4118us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034539.399692:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:1.0:1786034539.411726:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034539.411861:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608852608 00000100:00100000:2.0:1786034539.411873:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608852608 00000100:00100000:2.0:1786034539.411943:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00100000:2.0:1786034539.411953:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:9700:x1872792608852608:12345-192.168.203.56@tcp:36:mkdir.0 00010000:00010000:2.0:1786034539.412058:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034539.412098:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964582166e00/0x490975051af3fbb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758547 expref: 6 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.412124:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4700) 00010000:00010000:2.0:1786034539.412137:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786034539.412533:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3fcd7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.412549:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3fcd7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.412560:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3fcd7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.418712:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fcde lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.418735:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fcde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.418749:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fcde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034539.428714:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1786034539.428735:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3fcd7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.428745:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3fcd7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.428752:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3fcd7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.428758:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034539.428762:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3fcd7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.428770:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3fcd7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.428786:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96455a530b00) 00010000:00010000:0.0:1786034539.428789:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034539.428799:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3fcd7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.428806:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3fcd7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786034539.428858:0:5862:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000027dab9bc reply state 000000007e16a3b7 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fcde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034539.428868:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786034539.428966:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:9700:x1872792608852608:12345-192.168.203.56@tcp:36:mkdir.0 Request processed in 17010us (17249us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1786034539.428975:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 15 00010000:00010000:2.0:1786034539.431313:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fcde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.431329:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fcde lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.431500:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fcde lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.431517:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034539.431522:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fcde lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.431530:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fcde lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.431545:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96455a530800) 00010000:00010000:2.0:1786034539.431548:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034539.431552:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fcde lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.431559:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fcde lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034539.451908:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034539.452379:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608852736 00000100:00100000:0.0:1786034539.452389:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608852736 00000100:00100000:0.0:1786034539.452446:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:0.0:1786034539.452457:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:9703:x1872792608852736:12345-192.168.203.56@tcp:101:chmod.0 00010000:00010000:0.0:1786034539.452476:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034539.452497:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af3fce5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7585cc expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.452560:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fcec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.452573:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fcec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.452583:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fcec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034539.452636:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1786034539.452650:0:6743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034539.452696:0:6743:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fcec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.452718:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af3fce5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585cc expref: 8 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.452734:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fcec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585cc expref: 7 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.452742:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4600) 00010000:00010000:0.0:1786034539.452745:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034539.452748:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8400, rc 0) 00000100:00100000:0.0:1786034539.452807:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:9703:x1872792608852736:12345-192.168.203.56@tcp:101:chmod.0 Request processed in 352us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034539.452814:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:1.0:1786034539.456981:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034539.457086:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608852992 00000100:00100000:2.0:1786034539.457095:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608852992 00000100:00100000:2.0:1786034539.457147:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 17 00000100:00100000:2.0:1786034539.457157:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:9703:x1872792608852992:12345-192.168.203.56@tcp:36:chmod.0 00010000:00010000:2.0:1786034539.457212:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034539.457237:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fcec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585cc expref: 7 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.457264:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4600) 00010000:00010000:2.0:1786034539.457274:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786034539.457298:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fcf3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.457310:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fcf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.457329:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fcf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786034539.457769:0:5863:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000003f68a9fb reply state 000000006742ac56 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fcf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034539.457779:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1786034539.457792:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1786034539.457978:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:9703:x1872792608852992:12345-192.168.203.56@tcp:36:chmod.0 Request processed in 821us (1005us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1786034539.457985:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 17 00010000:00010000:1.0:1786034539.462475:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fcf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.462501:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fcf3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.462509:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fcf3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.462515:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034539.462520:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fcf3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.462527:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fcf3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.462542:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96455a530800) 00010000:00010000:1.0:1786034539.462545:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786034539.462548:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fcf3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.462554:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fcf3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034539.508908:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034539.509999:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608853120 00000100:00100000:0.0:1786034539.510008:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608853120 00000100:00100000:0.0:1786034539.510081:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 18 00000100:00100000:0.0:1786034539.510091:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:9704:x1872792608853120:12345-192.168.203.56@tcp:101:chown.0 00010000:00010000:0.0:1786034539.510121:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034539.510146:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af3fcfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7585d3 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.510209:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fd01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.510222:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fd01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.510250:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fd01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034539.510307:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1786034539.510311:0:6743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034539.510351:0:6743:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fd01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.510376:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af3fcfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585d3 expref: 9 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.510396:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fd01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585d3 expref: 8 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.510404:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034539.510406:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034539.510409:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8400, rc 0) 00000100:00100000:0.0:1786034539.510473:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:9704:x1872792608853120:12345-192.168.203.56@tcp:101:chown.0 Request processed in 383us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034539.510480:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 18 00000100:00100000:2.0:1786034539.519162:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034539.519278:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608853248 00000100:00100000:0.0:1786034539.519287:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608853248 00000100:00100000:0.0:1786034539.519337:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 19 00000100:00100000:0.0:1786034539.519346:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:9704:x1872792608853248:12345-192.168.203.56@tcp:101:chown.0 00010000:00010000:0.0:1786034539.519365:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034539.519384:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af3fd08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7585da expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519463:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3fd0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519476:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3fd0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519487:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3fd0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519501:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af3fd16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519508:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af3fd16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519515:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af3fd16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519606:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af3fd1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519615:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af3fd1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519621:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af3fd1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034539.519658:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1786034539.519661:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034539.519683:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af3fd1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519705:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3fd0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519712:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3fd0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519718:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3fd0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519725:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034539.519729:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3fd0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519736:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3fd0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519748:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034539.519751:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034539.519755:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3fd0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519761:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3fd0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519772:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af3fd16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519778:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af3fd16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519783:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af3fd16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519793:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034539.519796:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af3fd16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519802:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af3fd16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519809:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff964547ee4800) 00010000:00010000:0.0:1786034539.519811:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034539.519814:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af3fd16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519819:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af3fd16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519907:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af3fd08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585da expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519920:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af3fd1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585da expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.519927:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff964547ee4d00) 00010000:00010000:0.0:1786034539.519929:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034539.519932:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8600, rc 0) 00000100:00100000:0.0:1786034539.519978:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:9704:x1872792608853248:12345-192.168.203.56@tcp:101:chown.0 Request processed in 633us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034539.519985:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 19 00000100:00100000:3.0:1786034539.523576:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034539.524116:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608853504 00000100:00100000:0.0:1786034539.524132:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608853504 00000100:00100000:0.0:1786034539.524175:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00100000:0.0:1786034539.524184:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:9704:x1872792608853504:12345-192.168.203.56@tcp:36:chown.0 00010000:00010000:0.0:1786034539.524236:0:6743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034539.524395:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af3fd1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585da expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.524414:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff964547ee4d00) 00010000:00010000:0.0:1786034539.524423:0:6743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786034539.524444:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af3fd24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.524455:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af3fd24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034539.524463:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af3fd24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786034539.611685:0:6743:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000000eb7223d reply state 00000000671a60ab transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af3fd24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034539.611703:0:6743:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1786034539.611874:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1786034539.612012:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:9704:x1872792608853504:12345-192.168.203.56@tcp:36:chown.0 Request processed in 87825us (88440us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1786034539.612022:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 20 00000001:00080000:0.0:1786034539.612594:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1786034539.619787:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af3fd24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.619805:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af3fd24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.619813:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af3fd24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.620799:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034539.620807:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af3fd24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.620818:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af3fd24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.620859:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff964547ee4500) 00010000:00010000:3.0:1786034539.620862:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786034539.620866:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af3fd24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.620872:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af3fd24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034539.643096:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034539.643563:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608853632 00000100:00100000:0.0:1786034539.643574:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608853632 00000100:00100000:0.0:1786034539.643631:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 21 00000100:00100000:0.0:1786034539.643641:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:9705:x1872792608853632:12345-192.168.203.56@tcp:101:touch.500 00010000:00010000:0.0:1786034539.643666:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034539.643686:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af3fd2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7585e1 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786034539.645601:0:5862:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1869us 00010000:00010000:1.0:1786034539.679349:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fd32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.679368:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fd32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.679378:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fd32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.679392:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fd39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.679398:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fd39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.679403:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fd39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.679862:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af3fd40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.679871:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af3fd40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.679878:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af3fd40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034539.679955:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786034539.679959:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786034539.680061:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af3fd40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680085:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fd32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680091:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fd32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680098:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fd32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680103:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034539.680220:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fd32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680229:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fd32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680242:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:1.0:1786034539.680245:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034539.680249:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fd32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680256:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fd32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680268:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fd39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680274:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fd39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680279:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fd39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680291:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034539.680294:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fd39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680300:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fd39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680308:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9645521d1b00) 00010000:00010000:1.0:1786034539.680310:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034539.680313:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fd39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680318:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fd39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680356:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af3fd2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585e1 expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680370:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af3fd40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585e1 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.680378:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9645521d1d00) 00010000:00010000:1.0:1786034539.680380:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786034539.680383:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00c00, rc 0) 00000100:00100000:1.0:1786034539.680453:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:9705:x1872792608853632:12345-192.168.203.56@tcp:101:touch.500 Request processed in 36812us (37364us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034539.680461:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 21 00000100:00100000:2.0:1786034539.684363:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034539.684423:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608853888 00000100:00100000:1.0:1786034539.684440:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608853888 00000100:00100000:1.0:1786034539.684494:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:1.0:1786034539.684503:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:9705:x1872792608853888:12345-192.168.203.56@tcp:101:touch.500 00010000:00010000:1.0:1786034539.684521:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034539.684539:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af3fd47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7585e8 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.684815:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fd4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.684874:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fd4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.684885:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fd4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.684916:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af3fd55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.684924:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af3fd55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.684932:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af3fd55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786034539.686961:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1786034539.689395:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fd5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.689413:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fd5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.689438:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fd5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.689477:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fd4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.689484:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fd4e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.689490:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fd4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.689496:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034539.689500:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fd4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.689507:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fd4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.689519:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9645521d1d00) 00010000:00010000:1.0:1786034539.689521:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034539.689526:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fd4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.689532:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fd4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786034539.689544:0:5861:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000053c45ccd reply state 000000009d344c90 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af3fd55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034539.689553:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786034539.689595:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af3fd47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585e8 expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.689611:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fd5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585e8 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034539.689617:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9645521d1c00) 00010000:00010000:1.0:1786034539.689620:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034539.689622:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01000, rc 0) 00000100:00100000:1.0:1786034539.689736:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:9705:x1872792608853888:12345-192.168.203.56@tcp:101:touch.500 Request processed in 5233us (5379us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1786034539.689745:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 22 00010000:00010000:3.0:1786034539.701631:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af3fd55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.701649:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af3fd55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.701658:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af3fd55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.701680:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034539.701685:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af3fd55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.701692:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af3fd55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.701709:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff9645521d1000) 00010000:00010000:3.0:1786034539.701712:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034539.701716:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af3fd55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.701722:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af3fd55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034539.702656:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034539.702721:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608854144 00000100:00100000:3.0:1786034539.702730:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608854144 00000100:00100000:3.0:1786034539.702779:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 23 00000100:00100000:3.0:1786034539.702788:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454767bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:9705:x1872792608854144:12345-192.168.203.56@tcp:36:touch.500 00010000:00010000:3.0:1786034539.702879:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034539.702899:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fd5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585e8 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.702914:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9645521d1c00) 00010000:00010000:3.0:1786034539.702922:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034539.702959:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fd6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.702970:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fd6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.702989:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fd6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786034539.703249:0:5863:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000079dd1871 reply state 000000005fecde98 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fd6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034539.703258:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786034539.703352:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454767bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:9705:x1872792608854144:12345-192.168.203.56@tcp:36:touch.500 Request processed in 564us (699us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1786034539.703359:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 23 00010000:00010000:3.0:1786034539.705246:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fd6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.705259:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fd6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.705266:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fd6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.705272:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034539.705276:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fd6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.705284:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fd6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.705298:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034539.705301:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034539.705305:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fd6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034539.705324:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fd6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034539.707772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034539.707870:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608854272 00000100:00100000:2.0:1786034539.707880:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608854272 00000100:00100000:2.0:1786034539.707938:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 24 00000100:00100000:2.0:1786034539.707947:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:9705:x1872792608854272:12345-192.168.203.56@tcp:101:touch.500 00010000:00010000:2.0:1786034539.707969:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034539.707989:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3fd71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7585ef expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.708214:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3fd71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585ef expref: 10 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.708229:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3fd71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585ef expref: 10 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.708261:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96455a530100) 00010000:00010000:2.0:1786034539.708265:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786034539.708268:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0000, rc 0) 00000100:00100000:2.0:1786034539.708326:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:9705:x1872792608854272:12345-192.168.203.56@tcp:101:touch.500 Request processed in 379us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034539.708334:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 24 00000100:00100000:1.0:1786034539.713671:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034539.713759:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608854400 00000100:00100000:0.0:1786034539.713767:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608854400 00000100:00100000:0.0:1786034539.713876:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:0.0:1786034539.713883:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1872792608854400:12345-192.168.203.56@tcp:8:touch.500 00010000:00080000:0.0:1786034539.713915:0:6720:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp t0 exp 0000000000000000 cur 375 last 0 00000020:00000080:0.0:1786034539.713944:0:6720:0:(genops.c:1406:class_connect()) connect: client 696d4f9b-62ce-40a0-a754-08fa96a026cd, cookie 0x490975051af3fd78 00002000:00100000:0.0:1786034539.713956:0:6720:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 696d4f9b-62ce-40a0-a754-08fa96a026cd/ffff9645751ce800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113834 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786034539.713966:0:6720:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786034539.714384:0:6720:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786034539.714410:0:6720:0:(import.c:65:import_set_state_nolock()) ffff9645751c9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786034539.714468:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2361:x1872792608854400:12345-192.168.203.56@tcp:8:touch.500 Request processed in 584us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034539.714476:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:3.0:1786034539.727477:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034539.728132:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608854528 00000100:00100000:0.0:1786034539.728141:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608854528 00000100:00100000:0.0:1786034539.728209:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 17 00000100:00100000:0.0:1786034539.728219:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:0:x1872792608854528:12345-192.168.203.56@tcp:2:touch.500 00000100:00080000:3.0:1786034539.728538:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1786034539.863440:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1786034539.863457:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 696d4f9b-62ce-40a0-a754-08fa96a026cd 00000100:00100000:2.0:1786034539.863667:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:0:x1872792608854528:12345-192.168.203.56@tcp:2:touch.500 Request processed in 135443us (136193us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1786034539.864241:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 17 00000100:00100000:0.0:1786034539.879435:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034539.882734:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608854784 00000100:00100000:3.0:1786034539.882747:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608854784 00000100:00100000:3.0:1786034539.884255:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 2 00000100:00100000:3.0:1786034539.884270:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:9705:x1872792608854784:12345-192.168.203.56@tcp:35:touch.500 00000100:00100000:3.0:1786034539.884608:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+11:9705:x1872792608854784:12345-192.168.203.56@tcp:35:touch.500 Request processed in 343us (5181us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1786034539.884616:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 2 00000100:00100000:3.0:1786034539.935342:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034539.935919:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608854912 00000100:00100000:2.0:1786034539.935929:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608854912 00000100:00100000:2.0:1786034539.935992:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 25 00000100:00100000:2.0:1786034539.936002:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+11:9706:x1872792608854912:12345-192.168.203.56@tcp:101:rm.0 00010000:00010000:2.0:1786034539.936047:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034539.936068:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3fd7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7585f6 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.936489:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fd86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.936504:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fd86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.936572:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fd86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034539.937310:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1786034539.937326:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786034539.937366:0:5863:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fd86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.937392:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3fd7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585f6 expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.937410:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fd86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585f6 expref: 12 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.937418:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9645521d1d00) 00010000:00010000:2.0:1786034539.937420:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786034539.937424:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0e00, rc 0) 00000100:00100000:2.0:1786034539.937524:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+12:9706:x1872792608854912:12345-192.168.203.56@tcp:101:rm.0 Request processed in 1523us (2189us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034539.937532:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 25 00000100:00100000:0.0:1786034539.951276:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034539.951372:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608855168 00000100:00100000:2.0:1786034539.951381:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608855168 00000100:00100000:2.0:1786034539.951441:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 26 00000100:00100000:2.0:1786034539.951450:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+12:9706:x1872792608855168:12345-192.168.203.56@tcp:101:rm.0 00010000:00010000:2.0:1786034539.951471:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034539.951491:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3fd8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7585fd expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034539.951615:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1786034539.951783:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3fd8d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585fd expref: 14 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.951799:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:2.0:1786034539.951809:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786034539.951815:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3fd8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585fd expref: 14 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034539.951893:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0200, rc 0) 00000100:00100000:2.0:1786034539.951951:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:9706:x1872792608855168:12345-192.168.203.56@tcp:101:rm.0 Request processed in 502us (683us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1786034539.951959:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 26 00000100:00100000:0.0:1786034539.975251:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034539.975332:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608855296 00000100:00100000:1.0:1786034539.975341:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608855296 00000100:00100000:1.0:1786034539.975391:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 3 00000100:00100000:1.0:1786034539.975400:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:9706:x1872792608855296:12345-192.168.203.56@tcp:37:rm.0 00000100:00100000:1.0:1786034539.989962:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:9706:x1872792608855296:12345-192.168.203.56@tcp:37:rm.0 Request processed in 14553us (14710us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034539.989974:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 3 00000100:00100000:0.0:1786034540.013891:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034540.015242:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608855552 00000100:00100000:3.0:1786034540.015251:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608855552 00000100:00100000:0.0:1786034540.017264:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 4 00000100:00100000:0.0:1786034540.017276:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542eec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:9706:x1872792608855552:12345-192.168.203.56@tcp:35:rm.0 00000100:00100000:0.0:1786034540.017524:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542eec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:9706:x1872792608855552:12345-192.168.203.56@tcp:35:rm.0 Request processed in 250us (3641us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1786034540.017546:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 4 00000100:00100000:0.0:1786034540.025562:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034540.025650:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608855808 00000100:00100000:1.0:1786034540.025660:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608855808 00000100:00100000:1.0:1786034540.025718:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 27 00000100:00100000:1.0:1786034540.025728:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:9706:x1872792608855808:12345-192.168.203.56@tcp:101:rm.0 00010000:00010000:1.0:1786034540.025752:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034540.025782:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af3fd9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758604 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.025940:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fda2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.025953:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fda2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.025964:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fda2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034540.025974:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1786034540.026280:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af3fd9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758604 expref: 17 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.026298:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fda2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758604 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.026307:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9645521d1d00) 00010000:00010000:1.0:1786034540.026310:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786034540.026313:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01c00, rc 0) 00000100:00100000:1.0:1786034540.026359:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:9706:x1872792608855808:12345-192.168.203.56@tcp:101:rm.0 Request processed in 633us (807us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1786034540.026367:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 27 00000100:00100000:3.0:1786034540.029637:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034540.029717:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608855936 00000100:00100000:2.0:1786034540.029726:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608855936 00000100:00100000:2.0:1786034540.029780:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 28 00000100:00100000:2.0:1786034540.029790:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:9706:x1872792608855936:12345-192.168.203.56@tcp:41:rm.0 00000004:00000024:2.0:1786034540.029884:0:6743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1786034540.029941:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:9706:x1872792608855936:12345-192.168.203.56@tcp:41:rm.0 Request processed in 152us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034540.029948:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 28 00000100:00100000:0.0:1786034540.038441:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034540.038534:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608856064 00000100:00100000:2.0:1786034540.038543:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608856064 00000100:00100000:2.0:1786034540.038632:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 29 00000100:00100000:2.0:1786034540.038642:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:9706:x1872792608856064:12345-192.168.203.56@tcp:101:rm.0 00010000:00010000:2.0:1786034540.038663:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034540.038683:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3fdb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75860b expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.038744:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fdb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.038758:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fdb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.038780:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fdb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.038809:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fdbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.038855:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fdbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.038864:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fdbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.038966:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af3fdc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.038974:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af3fdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.038981:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af3fdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034540.039006:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1786034540.039010:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786034540.039026:0:5863:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af3fdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039037:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af3fdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039046:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fdb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039061:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fdb7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039067:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fdb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039073:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034540.039078:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fdb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039084:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fdb7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039095:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9645521d1d00) 00010000:00010000:2.0:1786034540.039098:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034540.039102:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fdb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039169:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3fdb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039185:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fdbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039191:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fdbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039197:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fdbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039202:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034540.039210:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fdbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039217:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fdbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039225:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff96455a530700) 00010000:00010000:2.0:1786034540.039228:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034540.039231:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fdbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039237:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fdbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039268:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3fdb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75860b expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039282:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af3fdc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75860b expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.039289:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96455a530100) 00010000:00010000:2.0:1786034540.039291:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786034540.039294:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7600, rc 0) 00000100:00100000:2.0:1786034540.039354:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+17:9706:x1872792608856064:12345-192.168.203.56@tcp:101:rm.0 Request processed in 713us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034540.039362:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 29 00000100:00100000:0.0:1786034540.043756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034540.044975:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608856320 00000100:00100000:3.0:1786034540.044985:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608856320 00000100:00100000:3.0:1786034540.045100:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 30 00000100:00100000:3.0:1786034540.045165:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+17:9706:x1872792608856320:12345-192.168.203.56@tcp:36:rm.0 00010000:00010000:3.0:1786034540.045213:0:6743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1786034540.045238:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af3fdc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75860b expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.045260:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3fd71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585ef expref: 16 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.045288:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96455a530100) 00010000:00010000:3.0:1786034540.045304:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3fd86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585f6 expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.045312:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9645521d1d00) 00010000:00010000:3.0:1786034540.045315:0:6743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034540.045333:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fdcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.045344:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fdcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.045352:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fdcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.045364:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3fdd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.045370:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3fdd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.045376:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3fdd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.045473:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af3fdda lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.045481:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af3fdda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.045497:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af3fdda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786034540.052307:0:6743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1786034540.052321:0:6743:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376260497263ns, next at 377260494798ns, rc = 0 00010000:00010000:2.0:1786034540.052391:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af3fde1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.052419:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af3fde1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.052429:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af3fde1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.052439:0:6743:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af3fde1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.052445:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af3fde1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.052451:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af3fde1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.052474:0:6743:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786034540.052495:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af3fdda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.052502:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af3fdda lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034540.052895:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034540.052903:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af3fde1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034540.052911:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7800 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034540.052915:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af3fde1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034540.052923:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af3fde1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034540.052936:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96454a119500) 00010000:00010000:0.0:1786034540.052939:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786034540.052944:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af3fde1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034540.053248:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af3fde1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034540.053265:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034540.053267:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034540.053269:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034540.053876:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af3fdda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.053883:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034540.053887:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af3fdda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.053893:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af3fdda lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.053916:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96454a119500) 00010000:00010000:2.0:1786034540.053919:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786034540.053922:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af3fdda lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.053928:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af3fdda lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.053949:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fdcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.053955:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fdcc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.053961:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fdcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.053966:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034540.053968:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fdcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.053974:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fdcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.053981:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9645521d1d00) 00010000:00010000:2.0:1786034540.053983:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034540.053986:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fdcc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.053991:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fdcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786034540.054009:0:6743:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000005500a8cc reply state 00000000d21066d5 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3fdd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034540.054017:0:6743:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786034540.054099:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:9706:x1872792608856320:12345-192.168.203.56@tcp:36:rm.0 Request processed in 8935us (10348us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1786034540.054574:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 30 00010000:00010000:1.0:1786034540.057679:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3fdd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.057694:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3fdd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.057716:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3fdd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.057722:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034540.057726:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3fdd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.057734:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3fdd3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.057747:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff96454a119e00) 00010000:00010000:1.0:1786034540.057750:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034540.057753:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3fdd3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.057759:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3fdd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034540.058436:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034540.058503:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608856576 00000100:00100000:2.0:1786034540.058520:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608856576 00000100:00100000:2.0:1786034540.058566:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 5 00000100:00100000:2.0:1786034540.058575:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:9706:x1872792608856576:12345-192.168.203.56@tcp:35:rm.0 00000100:00100000:2.0:1786034540.058812:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:9706:x1872792608856576:12345-192.168.203.56@tcp:35:rm.0 Request processed in 237us (378us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1786034540.058853:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 5 00000100:00100000:3.0:1786034540.068434:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034540.068533:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608856832 00000100:00100000:1.0:1786034540.068543:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608856832 00000100:00100000:1.0:1786034540.068598:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 31 00000100:00100000:1.0:1786034540.068608:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:9706:x1872792608856832:12345-192.168.203.56@tcp:36:rm.0 00010000:00010000:1.0:1786034540.068663:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1786034540.068689:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af3fda2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758604 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.068710:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af3fd40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585e1 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.068737:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9645521d1d00) 00010000:00010000:1.0:1786034540.068754:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fd01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585d3 expref: 14 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.068761:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:1.0:1786034540.068767:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786034540.068788:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af3fde8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.068799:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af3fde8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.068808:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af3fde8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.068875:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fdef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.068883:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fdef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.068890:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fdef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.069379:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fdf6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.069388:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fdf6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.069406:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fdf6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034540.069944:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1786034540.069957:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fdf6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.069964:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fdf6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.069970:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fdf6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.069977:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034540.069980:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fdf6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.069987:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fdf6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.069996:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9645521d1800) 00010000:00010000:1.0:1786034540.069999:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786034540.070003:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fdf6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.070009:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af3fdf6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.070024:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af3fde8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.070030:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af3fde8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.071239:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af3fde8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.071245:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034540.071248:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af3fde8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.071255:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af3fde8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.071266:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9645521d1b00) 00010000:00010000:1.0:1786034540.071268:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034540.071271:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af3fde8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034540.071277:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af3fde8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786034540.071293:0:5862:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000003cee76e reply state 00000000cc8bc814 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fdef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034540.071301:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786034540.071415:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:9706:x1872792608856832:12345-192.168.203.56@tcp:36:rm.0 Request processed in 2806us (2988us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1786034540.071423:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 31 00010000:00010000:3.0:1786034540.080520:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fdef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.080537:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fdef lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.080544:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fdef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.080557:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034540.080561:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fdef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.080568:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fdef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.080584:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9645521d1600) 00010000:00010000:3.0:1786034540.080587:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034540.080590:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fdef lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034540.080596:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fdef lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034540.209374:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034541.232019:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034541.406260:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034541.406305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034541.406368:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034541.406401:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034541.406437:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608856960 00000100:00100000:3.0:1786034541.406449:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608856960 00000100:00100000:3.0:1786034541.406522:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 265 00000100:00100000:3.0:1786034541.406534:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608856960:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034541.406630:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608856960:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 98us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034541.406638:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 265 00000100:00100000:3.0:1786034541.406674:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608857216 00000100:00100000:3.0:1786034541.406679:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608857216 00000100:00100000:1.0:1786034541.407067:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608857088 00000100:00100000:1.0:1786034541.407071:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608857088 00000100:00100000:1.0:1786034541.407109:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608857344 00000100:00100000:1.0:1786034541.407113:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608857344 00000100:00100000:1.0:1786034541.407136:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 137 00000100:00100000:1.0:1786034541.407152:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:2362:x1872792608857088:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034541.407191:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:2362:x1872792608857088:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 41us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034541.407198:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 137 00000100:00100000:1.0:1786034541.407213:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 138 00000100:00100000:1.0:1786034541.407220:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2362:x1872792608857344:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034541.407243:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2362:x1872792608857344:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 24us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034541.407249:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 138 00000100:00080000:1.0:1786034541.416849:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786034541.416862:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786034541.417166:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 60 00000100:00100000:1.0:1786034541.417205:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608857216:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034541.417327:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608857216:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 138us (10924us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034541.417336:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 60 00000100:00100000:0.0:1786034542.133023:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636158080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786034542.133089:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034542.134618:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636158080 00000100:00100000:3.0:1786034542.134633:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636158080 00000100:00100000:3.0:1786034542.134762:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1786034542.134779:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636158080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786034542.134849:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034542.134940:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636158080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (1850us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034542.134948:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1786034542.135004:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964551859880 x1872792636158080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034542.135026:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636158080:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786034542.136630:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786034542.258349:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034543.290285:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034544.183004:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636158208:0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183076:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034544.183117:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636158720:0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183143:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034544.183168:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786034544.183173:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636158336:0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183192:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034544.183206:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636158848:0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183224:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034544.183248:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636158464:0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034544.183279:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786034544.183284:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636158592:0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034544.183328:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636158208 00000100:00100000:0.0:1786034544.183334:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636158208 00000100:00100000:0.0:1786034544.183375:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1786034544.183382:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636158208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183424:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636158208:12345-0@lo:400:kworker.0 Request processed in 43us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034544.183431:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1786034544.183460:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636158720 00000100:00100000:0.0:1786034544.183463:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636158720 00000100:00100000:0.0:1786034544.183491:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636158336 00000100:00100000:0.0:1786034544.183494:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636158336 00000100:00100000:0.0:1786034544.183506:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636158464 00000100:00100000:0.0:1786034544.183514:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636158464 00000100:00100000:0.0:1786034544.183534:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1786034544.183539:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636158720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183572:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636158720:12345-0@lo:400:kworker.0 Request processed in 32us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034544.183577:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1786034544.183590:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1786034544.183596:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636158336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183622:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636158336:12345-0@lo:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034544.183628:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1786034544.183639:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1786034544.183645:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636158464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183673:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636158464:12345-0@lo:400:kworker.0 Request processed in 28us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034544.183679:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1786034544.183700:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636158848 00000100:00100000:0.0:1786034544.183705:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636158848 00000100:00100000:0.0:1786034544.183727:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636158592 00000100:00100000:0.0:1786034544.183729:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636158592 00000100:00100000:0.0:1786034544.183747:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786034544.183753:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636158848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183795:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636158848:12345-0@lo:400:kworker.0 Request processed in 30us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034544.183801:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786034544.183813:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786034544.183818:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636158592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183880:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636158592:12345-0@lo:400:kworker.0 Request processed in 62us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034544.183886:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1786034544.183928:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574a78000 x1872792636158592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034544.183942:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636158592:0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183951:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636158464:0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183976:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636158336:0@lo:400:kworker.0 00010000:00080000:0.0:1786034544.183984:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574a7b800 x1872792636158848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034544.183992:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636158848:0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.183999:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636158208:0@lo:400:kworker.0 00000100:00100000:0.0:1786034544.184006:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636158720:0@lo:400:kworker.0 00000100:00080000:2.0:1786034544.185096:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786034544.185101:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786034544.185105:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1786034544.186162:0:8042:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 380394337650ns, next at 381394335390ns, rc = 0 00000100:00100000:2.0:1786034544.186177:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786034544.186191:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636158976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034544.186235:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034544.186265:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636158976 00000100:00100000:2.0:1786034544.186270:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636158976 00000100:00100000:2.0:1786034544.186302:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1786034544.186318:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636158976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034544.186346:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034544.186382:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636158976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034544.186388:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1786034544.186414:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574c96d80 x1872792636158976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034544.186430:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636158976:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786034544.304648:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786034544.740372:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:3.0:1786034544.740469:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1786034544.740482:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:3.0:1786034544.740499:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1786034544.740677:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786034544.740696:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636159104:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786034544.740753:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034544.740907:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636159104 00000100:00100000:0.0:1786034544.740915:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636159104 00000100:00100000:0.0:1786034544.740963:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786034544.740973:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454767aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636159104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786034544.740996:0:8676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1786034544.741037:0:8676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a74b96a, atime: 0x6a74b96a, ctime: 0x6a74b96a, blocks: 0x1 00010000:00010000:0.0:1786034544.741045:0:8676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af3fdfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034544.741060:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1786034544.741075:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786034544.741082:0:8676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af3fdfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034544.741100:0:8676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af3fdfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034544.741111:0:8676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af3fdfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034544.741119:0:8676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af3fdfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034544.741143:0:8676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786034544.741361:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034544.741374:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af3fdfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034544.741383:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:3.0:1786034544.741388:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af3fdfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034544.741397:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af3fdfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034544.741415:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af3fdfd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034544.741422:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af3fdfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034544.741441:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034544.741443:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034544.741445:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034544.742030:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454767aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636159104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1058us (1274us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1786034544.742038:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1786034544.742240:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff964574a7bb80/2, rc 0, transno 4294967300 00000100:00100000:1.0:1786034544.742246:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636159104:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1786034545.259671:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1786034545.327939:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786034545.980540:0:11665:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1786034546.352095:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034546.544358:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034546.544396:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034546.544431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034546.544468:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034546.544498:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608857600 00000100:00100000:1.0:1786034546.544506:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608857600 00000100:00100000:1.0:1786034546.544564:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608857856 00000100:00100000:1.0:1786034546.544568:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608857856 00000100:00100000:1.0:1786034546.544601:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 142 00000100:00100000:1.0:1786034546.544610:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2364:x1872792608857600:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034546.544690:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2364:x1872792608857600:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 81us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034546.544697:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 142 00000100:00100000:1.0:1786034546.544713:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 143 00000100:00100000:1.0:1786034546.544720:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608857856:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034546.544743:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608857856:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 24us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034546.544748:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 143 00000100:00100000:2.0:1786034546.545689:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608857472 00000100:00100000:2.0:1786034546.545694:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608857472 00000100:00100000:2.0:1786034546.545725:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 267 00000100:00100000:2.0:1786034546.545731:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608857472:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034546.545762:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608857472:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 32us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034546.545779:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 267 00000100:00100000:2.0:1786034546.545804:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608857728 00000100:00100000:2.0:1786034546.545808:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608857728 00000100:00100000:2.0:1786034546.545845:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 63 00000100:00100000:2.0:1786034546.545850:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2364:x1872792608857728:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034546.545872:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2364:x1872792608857728:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 22us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034546.545877:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 63 00000100:00080000:2.0:1786034546.545900:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786034546.545910:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034547.248070:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636159232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034547.248155:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034547.248277:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636159232 00000100:00100000:3.0:1786034547.248286:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636159232 00000100:00100000:3.0:1786034547.248358:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1786034547.248369:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636159232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786034547.248411:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034547.248458:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636159232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034547.248466:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1786034547.248536:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786034547.248569:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d65b800 x1872792636159232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034547.248591:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636159232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786034547.376808:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786034547.730603:0:11713:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf736a8e0 20000000:00000080:3.0:1786034547.730622:0:11713:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96457650f400 uarg=0000000000000000 20000000:01000000:3.0:1786034547.730667:0:11713:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1786034547.730674:0:11713:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1786034547.730680:0:11713:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1786034547.736728:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1786034547.740009:0:11713:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1786034547.762573:0:11713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1786034547.762622:0:11713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1786034547.762672:0:11713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1786034547.762692:0:11713:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1786034547.762721:0:11713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.762741:0:11713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964574d01600/0x490975051af3fca6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fc9f expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.762750:0:11713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964542df9200/0x490975051af3fcb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fcad expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.762768:0:11713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964574d00000/0x490975051af3fcc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fcbb expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.762779:0:11713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964562313c00/0x490975051af3fcc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585be expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.762786:0:11713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964542df9800/0x490975051af3fcd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585c5 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.762794:0:11713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.762866:0:11713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964542df9800/0x490975051af3fcd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585c5 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.762882:0:11713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964542df9800/0x490975051af3fcd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585c5 expref: 12 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034547.762900:0:11713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e073800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11713:1872792636159360:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034547.763134:0:11713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964562313c00/0x490975051af3fcc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585be expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763154:0:11713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964562313c00/0x490975051af3fcc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585be expref: 12 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034547.763165:0:11713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e073480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11713:1872792636159488:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034547.763207:0:11713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964574d00000/0x490975051af3fcc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fcbb expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763215:0:11713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964574d00000/0x490975051af3fcc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fcbb expref: 18 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034547.763225:0:11713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e073100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11713:1872792636159616:0@lo:104: 00000100:00100000:1.0:1786034547.763265:0:11713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786034547.763296:0:11713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964542df9200/0x490975051af3fcb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fcad expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763305:0:11713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964542df9200/0x490975051af3fcb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fcad expref: 18 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034547.763312:0:11713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e072680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11713:1872792636159744:0@lo:104: 00000100:00100000:1.0:1786034547.763333:0:11713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034547.763361:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636159616 00000100:00100000:1.0:1786034547.763369:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636159616 00000100:00100000:1.0:1786034547.763409:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636159744 00000100:00100000:1.0:1786034547.763412:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636159744 00000100:00100000:1.0:1786034547.763429:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786034547.763438:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e071c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+4:11713:x1872792636159616:12345-0@lo:104: 00010000:00010000:1.0:1786034547.763453:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fcc2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763506:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786034547.763513:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e071c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+4:11713:x1872792636159616:12345-0@lo:104: Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034547.763521:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786034547.763539:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786034547.763544:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:11713:x1872792636159744:12345-0@lo:104: 00010000:00010000:1.0:1786034547.763552:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fcb4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763597:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1786034547.763602:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:11713:x1872792636159744:12345-0@lo:104: Request processed in 58us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034547.763609:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1786034547.763625:0:7670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786034547.763632:0:7670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fcc2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763641:0:7670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0800 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:1.0:1786034547.763645:0:7670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fcc2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763656:0:7670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fcc2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786034547.763665:0:7670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fcc2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034547.763671:0:7670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786034547.763706:0:7670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fcc2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763713:0:7670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786034547.763733:0:7670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fcc2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763741:0:7670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af3fcbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fcc2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763766:0:7670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034547.763769:0:7670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fcb4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763775:0:7670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00a00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:1.0:1786034547.763779:0:7670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fcb4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763787:0:7670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fcb4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786034547.763794:0:7670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fcb4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034547.763799:0:7670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786034547.763811:0:7670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fcb4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763818:0:7670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786034547.763858:0:7670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fcb4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763877:0:7670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964574d00a00/0x490975051af3fcad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fcb4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.763887:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034547.763888:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034547.763890:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034547.763896:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034547.763908:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636159872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034547.763938:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034547.763977:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636160000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034547.764003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786034547.764044:0:11713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964574d01600/0x490975051af3fca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af3fc9f expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.764054:0:11713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff964574d01600/0x490975051af3fca6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af3fc9f expref: 18 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034547.764062:0:11713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e60e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11713:1872792636160128:0@lo:104: 00000100:00100000:1.0:1786034547.764088:0:11713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034547.764113:0:5845:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1786034547.764123:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636160128 00000100:00100000:1.0:1786034547.764127:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636160128 00000100:00100000:1.0:1786034547.764145:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786034547.764150:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e020450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:11713:x1872792636160128:12345-0@lo:104: 00010000:00010000:1.0:1786034547.764157:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fca6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.764202:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786034547.764208:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e020450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+3:11713:x1872792636160128:12345-0@lo:104: Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034547.764214:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1786034547.764249:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034547.764253:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af3fca6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.764260:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9c00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:1.0:1786034547.764263:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af3fca6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.764270:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af3fca6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786034547.764277:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af3fca6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034547.764283:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786034547.764297:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fca6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.764302:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786034547.764314:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fca6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.764321:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964542df9c00/0x490975051af3fc9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af3fca6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.764345:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034547.764347:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034547.764348:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034547.764359:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964549e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636160256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034547.764387:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034547.764421:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636159872 00000100:00100000:1.0:1786034547.764425:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636159872 00010000:00010000:1.0:1786034547.764441:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964574d00000/0x490975051af3fcc2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fcbb expref: 19 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034547.764460:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636160000 00000100:00100000:1.0:1786034547.764463:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636160000 00010000:00010000:1.0:1786034547.764473:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964542df9200/0x490975051af3fcb4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fcad expref: 20 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034547.764481:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636160256 00000100:00100000:1.0:1786034547.764483:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636160256 00010000:00010000:1.0:1786034547.764491:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964574d01600/0x490975051af3fca6 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fc9f expref: 21 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034547.764501:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786034547.764506:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+21:3310:x1872792636159872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786034547.764515:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034547.764520:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964574d00000/0x490975051af3fcc2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fcbb expref: 21 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.764529:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964574d00000/0x490975051af3fcc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fcbb expref: 21 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.764556:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034547.764585:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+21:3310:x1872792636159872:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034547.764591:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786034547.764604:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786034547.764610:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+20:3307:x1872792636160000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786034547.764617:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034547.764622:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964542df9200/0x490975051af3fcb4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fcad expref: 20 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.764629:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964542df9200/0x490975051af3fcb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fcad expref: 20 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.764639:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034547.764662:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+20:3307:x1872792636160000:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034547.764668:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786034547.764680:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786034547.764686:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a060050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636160256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786034547.764693:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034547.764698:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964574d01600/0x490975051af3fca6 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af3fc9f expref: 19 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.764706:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964574d01600/0x490975051af3fca6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af3fc9f expref: 19 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.764715:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034547.764748:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a060050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636160256:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034547.764767:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786034547.764845:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636159872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034547.764873:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636160000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034547.764890:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636160256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034547.764910:0:11713:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560bf7f00 going to sleep for 11 seconds 00010000:00010000:1.0:1786034547.764922:0:11713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964574d00000/0x490975051af3fcc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fcbb expref: 18 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034547.764933:0:11713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e073100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11713:1872792636159616:0@lo:104: 00010000:00010000:1.0:1786034547.764943:0:11713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964542df9200/0x490975051af3fcb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fcad expref: 17 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034547.764951:0:11713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e072680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11713:1872792636159744:0@lo:104: 00010000:00010000:1.0:1786034547.764958:0:11713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964574d01600/0x490975051af3fca6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af3fc9f expref: 16 pid: 5855 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034547.764966:0:11713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964549e60e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11713:1872792636160128:0@lo:104: 00000100:00100000:1.0:1786034547.778155:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034547.778490:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608857984 00000100:00100000:2.0:1786034547.778502:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608857984 00010000:00010000:2.0:1786034547.778552:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964542df9800/0x490975051af3fcd0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585c5 expref: 13 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034547.778604:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 33 00000100:00100000:2.0:1786034547.778616:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608857984:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034547.778634:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034547.778641:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964542df9800/0x490975051af3fcd0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585c5 expref: 13 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034547.778657:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964542df9800/0x490975051af3fcd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585c5 expref: 13 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034547.778685:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034547.778751:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608857984:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 137us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034547.778771:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 33 00000100:00100000:1.0:1786034547.778914:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034547.778938:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608858112 00000100:00100000:1.0:1786034547.778941:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608858112 00010000:00010000:1.0:1786034547.778958:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964562313c00/0x490975051af3fcc9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585be expref: 13 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034547.778991:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 34 00000100:00100000:1.0:1786034547.779016:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608858112:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034547.779024:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034547.779031:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964562313c00/0x490975051af3fcc9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585be expref: 13 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.779040:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964562313c00/0x490975051af3fcc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585be expref: 13 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.779053:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.779063:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.779079:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.779087:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.779093:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.779099:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.779105:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01200 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034547.779109:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.779117:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.779134:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034547.779145:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034547.779165:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608858112:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 151us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034547.779172:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 34 00010000:00010000:3.0:1786034547.782133:0:11713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964542df9800/0x490975051af3fcd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585c5 expref: 12 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034547.782159:0:11713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e073800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11713:1872792636159360:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034547.783885:0:11713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964562313c00/0x490975051af3fcc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7585be expref: 11 pid: 5855 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034547.783904:0:11713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e073480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11713:1872792636159488:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034547.783947:0:11713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034547.783957:0:11713:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034547.783964:0:11713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034547.783970:0:11713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964574d01200/0x490975051af3fe04 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034548.401303:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034549.296629:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786034549.296660:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636160384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034549.296741:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034549.297478:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636160384 00000100:00100000:2.0:1786034549.297488:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636160384 00000100:00100000:2.0:1786034549.297570:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786034549.297582:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636160384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034549.297627:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034549.297683:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636160384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034549.297692:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1786034549.297849:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1786034549.297856:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff964574a7bb80, transno 4294967300 00000100:00100000:3.0:1786034549.297879:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636160384:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1786034549.297996:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786034549.298305:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636160896:0@lo:400:kworker.0 00000100:00100000:1.0:1786034549.298343:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034549.298381:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786034549.298387:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636160512:0@lo:400:kworker.0 00000100:00100000:1.0:1786034549.298416:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034549.298434:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636161024:0@lo:400:kworker.0 00000100:00100000:3.0:1786034549.298539:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636160896 00000100:00100000:3.0:1786034549.298545:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636160896 00000100:00100000:3.0:1786034549.298585:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786034549.298592:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636160896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034549.298629:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636160896:12345-0@lo:400:kworker.0 Request processed in 37us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034549.298636:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786034549.298659:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636160512 00000100:00100000:3.0:1786034549.298663:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636160512 00000100:00100000:3.0:1786034549.298690:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1786034549.298697:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3309:x1872792636160512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034549.298724:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3309:x1872792636160512:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034549.298731:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1786034549.298790:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636160640:0@lo:400:kworker.0 00000100:00100000:3.0:1786034549.298845:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636160768:0@lo:400:kworker.0 00000100:00100000:1.0:1786034549.298911:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1786034549.298954:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d658a80 x1872792636160896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034549.298980:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636160896:0@lo:400:kworker.0 00000100:00100000:1.0:1786034549.299001:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636160512:0@lo:400:kworker.0 00000100:00100000:1.0:1786034549.299021:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034549.299052:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636161024 00000100:00100000:1.0:1786034549.299056:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636161024 00000100:00100000:1.0:1786034549.299083:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636160768 00000100:00100000:1.0:1786034549.299085:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636160768 00000100:00100000:1.0:1786034549.299103:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1786034549.299109:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636161024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034549.299159:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636161024:12345-0@lo:400:kworker.0 Request processed in 50us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034549.299166:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1786034549.299179:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1786034549.299185:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636160768:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1786034549.299786:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786034549.299791:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786034549.307621:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034549.310398:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636160768:12345-0@lo:400:kworker.0 Request processed in 11201us (11364us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034549.310414:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1786034549.310468:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636160640 00000100:00100000:1.0:1786034549.310477:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636160640 00000100:00100000:1.0:1786034549.310525:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1786034549.310533:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636160640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034549.310602:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636160640:12345-0@lo:400:kworker.0 Request processed in 70us (2994us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034549.310609:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1786034549.312548:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636160768:0@lo:400:kworker.0 00000100:00100000:0.0:1786034549.312599:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636160640:0@lo:400:kworker.0 00000100:00100000:2.0:1786034549.319163:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636161024:0@lo:400:kworker.0 00010000:00010000:1.0:1786034549.424524:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1786034549.487978:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786034549.487988:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96457642c000 from 7 10000000:01000000:2.0:1786034549.487994:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786034549.488064:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034549.488078:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034549.488092:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034549.488125:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636161152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786034549.488235:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034549.488323:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455d0a9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786034549.488731:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636161152 00000100:00100000:1.0:1786034549.488740:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636161152 00000100:00100000:1.0:1786034549.488819:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1786034549.488851:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:5858:x1872792636161152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786034549.488867:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034549.488884:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964574d01600/0x490975051af3fe12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fe0b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034549.488911:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d01600/0x490975051af3fe12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fe0b expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034549.488944:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964574d01600/0x490975051af3fe12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fe0b expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034549.488954:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01600, rc 0) 00000100:00100000:1.0:1786034549.489007:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636161152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034549.489014:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1786034549.489320:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636161152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786034549.489338:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fe12 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034549.489347:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fe12 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034549.489414:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636161280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034549.489444:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034549.489571:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455d0a9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786034549.492981:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636161280 00000100:00100000:3.0:1786034549.492995:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636161280 00000100:00100000:3.0:1786034549.493059:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1786034549.493069:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636161280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034549.493601:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636161280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 532us (4155us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034549.493619:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1786034549.493783:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636161280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034549.493870:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636161408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786034549.493941:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034549.493977:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455d0a9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786034549.494110:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636161408 00000100:00100000:3.0:1786034549.494115:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636161408 00000100:00100000:3.0:1786034549.494150:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1786034549.494158:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636161408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034549.494381:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636161408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034549.494388:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1786034549.502561:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636161408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786034549.504246:0:11727:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:11727:1872792636161536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786034549.504346:0:11727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034549.504394:0:11727:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455d0a9840 going to sleep for 11 seconds 00000100:00100000:3.0:1786034549.504534:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636161536 00000100:00100000:3.0:1786034549.504543:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636161536 00000100:00100000:3.0:1786034549.504600:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1786034549.504610:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:11727:x1872792636161536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034549.504893:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:11727:x1872792636161536:12345-0@lo:502:llog_process_th.0 Request processed in 283us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034549.504902:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1786034549.505184:0:11727:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:11727:1872792636161536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786034549.505222:0:11727:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786034549.505233:0:11727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034549.505236:0:11727:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1786034549.505244:0:11727:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96457642c000 00000020:00000080:2.0:1786034549.505247:0:11727:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786034549.505334:0:11727:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:11727:1872792636161664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786034549.505369:0:11727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034549.505397:0:11727:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455d0a9840 going to sleep for 11 seconds 00000100:00100000:3.0:1786034549.507448:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636161664 00000100:00100000:3.0:1786034549.507465:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636161664 00000100:00100000:3.0:1786034549.507514:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1786034549.507523:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:11727:x1872792636161664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034549.507760:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:11727:x1872792636161664:12345-0@lo:502:llog_process_th.0 Request processed in 238us (2389us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034549.507770:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1786034549.509594:0:11727:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:11727:1872792636161664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786034549.509638:0:11727:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786034549.509646:0:11727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034549.509649:0:11727:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1786034549.509655:0:11727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1786034549.510653:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1786034549.510677:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786034549.510691:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fe12 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034549.510720:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fe12 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034549.510733:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786034549.510736:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff964548917000 from 7 10000000:01000000:3.0:1786034549.510740:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786034549.510790:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034549.510798:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034549.510809:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034549.510866:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636161792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786034549.510978:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034549.511021:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a9430c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034549.514250:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636161792 00000100:00100000:2.0:1786034549.514266:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636161792 00000100:00100000:2.0:1786034549.514327:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1786034549.514339:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:5858:x1872792636161792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786034549.514359:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034549.514381:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964548aa6200/0x490975051af3fe20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fe19 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034549.514594:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964548aa6200/0x490975051af3fe20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fe19 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034549.514609:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964548aa6200/0x490975051af3fe20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fe19 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034549.514618:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6200, rc 0) 00000100:00100000:2.0:1786034549.522338:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636161792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 7989us (11348us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034549.522352:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1786034549.529951:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636161792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034549.529988:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034549.530002:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034549.530094:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636161920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034549.530164:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034549.530274:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a9430c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034549.532188:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636161920 00000100:00100000:2.0:1786034549.532200:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636161920 00000100:00100000:2.0:1786034549.532256:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1786034549.532266:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636161920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034549.532657:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636161920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 392us (2492us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034549.532665:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1786034549.532768:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636161920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034549.532857:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636162048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034549.532904:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034549.532950:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c6ee900 going to sleep for 11 seconds 00000100:00100000:2.0:1786034549.533045:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636162048 00000100:00100000:2.0:1786034549.533050:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636162048 00000100:00100000:2.0:1786034549.533080:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1786034549.533086:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636162048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786034549.533240:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636162048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034549.533247:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1786034549.533288:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636162048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786034549.534635:0:11730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:11730:1872792636162176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786034549.534691:0:11730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034549.534728:0:11730:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d586c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034549.534895:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636162176 00000100:00100000:3.0:1786034549.534903:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636162176 00000100:00100000:3.0:1786034549.534945:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1786034549.534954:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:11730:x1872792636162176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034549.535140:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:11730:x1872792636162176:12345-0@lo:502:llog_process_th.0 Request processed in 187us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034549.535148:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1786034549.535737:0:11730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:11730:1872792636162176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786034549.535779:0:11730:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786034549.535791:0:11730:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034549.535794:0:11730:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1786034549.535803:0:11730:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff964548917000 00000020:00000080:2.0:1786034549.535806:0:11730:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786034549.535921:0:11730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:11730:1872792636162304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786034549.537599:0:11730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034549.537647:0:11730:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d586c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034549.538007:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636162304 00000100:00100000:0.0:1786034549.538017:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636162304 00000100:00100000:0.0:1786034549.538058:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1786034549.538066:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:11730:x1872792636162304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034549.540811:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:11730:x1872792636162304:12345-0@lo:502:llog_process_th.0 Request processed in 2735us (3203us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034549.540844:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1786034549.541817:0:11730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:11730:1872792636162304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786034549.541884:0:11730:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786034549.541893:0:11730:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034549.541896:0:11730:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1786034549.541902:0:11730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1786034549.543644:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1786034549.543674:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786034549.543689:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034549.543704:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034549.543716:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786034549.543719:0:5858:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff964559843800 from 7 10000000:01000000:3.0:1786034549.543723:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786034549.543777:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034549.543786:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034549.543798:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034549.543845:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636162432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786034549.543912:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034549.544201:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a943e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786034549.544579:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636162432 00000100:00100000:0.0:1786034549.544588:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636162432 00000100:00100000:0.0:1786034549.544641:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1786034549.544650:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:5858:x1872792636162432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786034549.544665:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034549.544680:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df9000/0x490975051af3fe2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af3fe27 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034549.544707:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df9000/0x490975051af3fe2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af3fe27 expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034549.544718:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df9000/0x490975051af3fe2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af3fe27 expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034549.544728:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9000, rc 0) 00000100:00100000:0.0:1786034549.550625:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636162432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5961us (6699us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034549.550667:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1786034549.561983:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636162432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786034549.562024:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034549.562040:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034549.562185:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636162560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034549.562261:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034549.562333:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d586c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034549.562398:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636162560 00000100:00100000:0.0:1786034549.562406:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636162560 00000100:00100000:0.0:1786034549.562465:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1786034549.562476:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636162560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034549.562780:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636162560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034549.562788:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1786034549.562907:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636162560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034549.562940:0:5858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d658700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636162688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034549.562981:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034549.563012:0:5858:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a943e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786034549.563063:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636162688 00000100:00100000:0.0:1786034549.563068:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636162688 00000100:00100000:0.0:1786034549.563097:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1786034549.563105:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636162688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034549.563259:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:5858:x1872792636162688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034549.563267:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1786034549.563346:0:5858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d658700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:117a9d0c-602c-47bd-a536-8de3b3d11e1e:5858:1872792636162688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034549.564286:0:11731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d658700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:11731:1872792636162816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034549.564329:0:11731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034549.564348:0:11731:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a9430c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034549.564481:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636162816 00000100:00100000:0.0:1786034549.564486:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636162816 00000100:00100000:0.0:1786034549.564517:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1786034549.564524:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:11731:x1872792636162816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034549.564671:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:11731:x1872792636162816:12345-0@lo:502:llog_process_th.0 Request processed in 147us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034549.564679:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1786034549.567143:0:11731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d658700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:11731:1872792636162816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786034549.567188:0:11731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786034549.567199:0:11731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786034549.567202:0:11731:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1786034549.567211:0:11731:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff964559843800 00000020:00000080:3.0:1786034549.567214:0:11731:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1786034549.567313:0:11731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d658700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:11731:1872792636162944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034549.567375:0:11731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034549.567407:0:11731:0:(client.c:2702:ptlrpc_set_wait()) set ffff964553aa7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786034549.568108:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636162944 00000100:00100000:0.0:1786034549.568116:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636162944 00000100:00100000:0.0:1786034549.568167:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1786034549.568176:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:11731:x1872792636162944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034549.568405:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:11731:x1872792636162944:12345-0@lo:502:llog_process_th.0 Request processed in 229us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034549.568414:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1786034549.568633:0:11731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d658700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:117a9d0c-602c-47bd-a536-8de3b3d11e1e:11731:1872792636162944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786034549.568656:0:11731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786034549.568660:0:11731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786034549.568662:0:11731:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1786034549.568667:0:11731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1786034549.570327:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1786034549.570361:0:5858:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786034549.570373:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034549.570389:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786034549.590739:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1786034549.743952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034549.744381:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608858240 00000100:00100000:0.0:1786034549.744393:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608858240 00000100:00100000:0.0:1786034549.744462:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 284 00000100:00100000:0.0:1786034549.744474:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+11:5613:x1872792608858240:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786034549.744494:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034549.744517:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df8800/0x490975051af3fe35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758612 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034549.744551:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df8800/0x490975051af3fe35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758612 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034549.744563:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df8800/0x490975051af3fe35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758612 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034549.744573:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8800, rc 0) 00000100:00100000:0.0:1786034549.744646:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:5613:x1872792608858240:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 Request processed in 174us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034549.744671:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 284 00000100:00100000:3.0:1786034549.748789:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034549.751403:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608858368 00000100:00100000:0.0:1786034549.751418:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608858368 00000100:00100000:0.0:1786034549.751501:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 285 00000100:00100000:0.0:1786034549.751512:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:5613:x1872792608858368:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034549.752300:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:5613:x1872792608858368:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 Request processed in 788us (3522us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034549.752310:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 285 00000100:00100000:3.0:1786034549.754912:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034549.755029:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608858496 00000100:00100000:1.0:1786034549.755039:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608858496 00000100:00100000:1.0:1786034549.755094:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 286 00000100:00100000:1.0:1786034549.755103:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:5613:x1872792608858496:12345-192.168.203.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786034549.755354:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:5613:x1872792608858496:12345-192.168.203.56@tcp:503:ll_cfg_requeue.0 Request processed in 250us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034549.755362:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 286 00000100:00100000:0.0:1786034549.779145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034549.779502:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608858624 00000100:00100000:2.0:1786034549.779514:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608858624 00000100:00100000:2.0:1786034549.779588:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 287 00000100:00100000:2.0:1786034549.779598:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:9977:x1872792608858624:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786034549.779928:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:9977:x1872792608858624:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 330us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034549.779936:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 287 00000100:00100000:0.0:1786034549.783346:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034549.786804:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608858752 00000100:00100000:3.0:1786034549.786817:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608858752 00000100:00100000:3.0:1786034549.786921:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 288 00000100:00100000:3.0:1786034549.786933:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:9977:x1872792608858752:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786034549.788275:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:9977:x1872792608858752:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 1342us (4937us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034549.788284:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 288 00000100:00100000:3.0:1786034549.804399:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034549.804511:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608858880 00000100:00100000:1.0:1786034549.804528:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608858880 00000100:00100000:1.0:1786034549.804578:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 289 00000100:00100000:1.0:1786034549.804587:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:5613:x1872792608858880:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786034549.804603:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034549.804620:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964574d00000/0x490975051af3fe3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758619 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034549.804647:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d00000/0x490975051af3fe3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758619 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034549.804659:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964574d00000/0x490975051af3fe3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758619 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034549.804681:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00000, rc 0) 00000100:00100000:1.0:1786034549.804748:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:5613:x1872792608858880:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 Request processed in 154us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034549.804757:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 289 00000100:00100000:0.0:1786034549.806665:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034549.809168:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608859008 00000100:00100000:3.0:1786034549.809179:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608859008 00000100:00100000:3.0:1786034549.809228:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 290 00000100:00100000:3.0:1786034549.809237:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:5613:x1872792608859008:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034549.809505:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:5613:x1872792608859008:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 Request processed in 268us (2843us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034549.809525:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 290 00000100:00100000:0.0:1786034549.827475:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034549.828005:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608859136 00000100:00100000:2.0:1786034549.828139:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608859136 00000100:00100000:2.0:1786034549.828195:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 291 00000100:00100000:2.0:1786034549.828204:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:5613:x1872792608859136:12345-192.168.203.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786034549.828385:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:5613:x1872792608859136:12345-192.168.203.56@tcp:503:ll_cfg_requeue.0 Request processed in 182us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034549.828394:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 291 00000100:00100000:0.0:1786034549.845091:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034549.845752:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608859264 00000100:00100000:3.0:1786034549.845763:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608859264 00000100:00100000:3.0:1786034549.845819:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 292 00000100:00100000:3.0:1786034549.845856:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:9980:x1872792608859264:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786034549.847946:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:9980:x1872792608859264:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 2089us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034549.847955:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 292 00000100:00100000:0.0:1786034549.864715:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034549.864796:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608859392 00000100:00100000:1.0:1786034549.864805:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608859392 00000100:00100000:1.0:1786034549.864893:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 293 00000100:00100000:1.0:1786034549.864903:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:9980:x1872792608859392:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786034549.865144:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:9980:x1872792608859392:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 241us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034549.865152:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 293 00010000:00010000:1.0:1786034550.448005:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786034550.642953:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786034551.472050:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034551.655676:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034551.655717:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034551.655770:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034551.656326:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608859648 00000100:00100000:3.0:1786034551.656339:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608859648 00000100:00100000:3.0:1786034551.656421:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608859904 00000100:00100000:3.0:1786034551.656424:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608859904 00000100:00100000:2.0:1786034551.656459:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608859520 00000100:00100000:2.0:1786034551.656464:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608859520 00000100:00100000:3.0:1786034551.656477:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 147 00000100:00100000:3.0:1786034551.656487:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608859648:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034551.656492:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 294 00000100:00100000:2.0:1786034551.656499:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608859520:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034551.656576:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 148 00000100:00100000:0.0:1786034551.656585:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2362:x1872792608859904:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034551.656651:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608859648:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 165us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034551.656660:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 147 00000100:00080000:3.0:1786034551.656683:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034551.659864:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608859520:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 3351us (4079us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034551.659877:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 294 00000100:00100000:0.0:1786034551.673714:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2362:x1872792608859904:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 17114us (17979us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034551.673742:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 148 00000100:00100000:0.0:1786034551.676694:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034551.676812:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608859776 00000100:00100000:2.0:1786034551.676855:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608859776 00000100:00100000:2.0:1786034551.676936:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 65 00000100:00100000:2.0:1786034551.676947:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608859776:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034551.677036:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608859776:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 92us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034551.677045:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 65 00000100:00080000:3.0:1786034551.677153:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786034552.368470:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786034552.368501:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636163072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034552.368579:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034552.370284:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636163072 00000100:00100000:2.0:1786034552.370297:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636163072 00000100:00100000:2.0:1786034552.370395:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786034552.370407:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636163072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786034552.370452:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034552.370530:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636163072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034552.370539:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1786034552.370610:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786034552.370687:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d658700 x1872792636163072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034552.370708:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636163072:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786034552.498979:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034553.520676:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034554.416455:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636163456:0@lo:400:kworker.0 00000100:00100000:0.0:1786034554.416573:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034554.416650:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786034554.416657:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636163328:0@lo:400:kworker.0 00000100:00100000:0.0:1786034554.416682:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034554.416699:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636163840:0@lo:400:kworker.0 00000100:00100000:0.0:1786034554.416740:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034554.416775:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636163456 00000100:00100000:0.0:1786034554.416784:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636163456 00000100:00100000:0.0:1786034554.416875:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636163328 00000100:00100000:0.0:1786034554.416879:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636163328 00000100:00100000:0.0:1786034554.416903:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1786034554.416911:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636163456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034554.417069:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636163200:0@lo:400:kworker.0 00000100:00100000:1.0:1786034554.417110:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034554.417133:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636163712:0@lo:400:kworker.0 00000100:00100000:1.0:1786034554.417178:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034554.417191:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786034554.417197:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636163584:0@lo:400:kworker.0 00000100:00100000:1.0:1786034554.417218:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786034554.417262:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034554.417276:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636163840 00000100:00100000:1.0:1786034554.417280:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636163840 00000100:00100000:1.0:1786034554.417311:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636163584 00000100:00100000:1.0:1786034554.417315:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636163584 00000100:00100000:1.0:1786034554.417336:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786034554.417343:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636163840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034554.417397:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636163840:12345-0@lo:400:kworker.0 Request processed in 54us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034554.417405:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786034554.417423:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1786034554.417429:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636163584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034554.417460:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636163584:12345-0@lo:400:kworker.0 Request processed in 32us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034554.417467:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1786034554.417482:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034554.417485:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1786034554.417539:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574a78380 x1872792636163584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034554.417555:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636163584:0@lo:400:kworker.0 00000100:00100000:1.0:1786034554.417692:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636163712 00000100:00100000:1.0:1786034554.417696:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636163712 00000100:00100000:1.0:1786034554.417735:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1786034554.417748:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636163328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034554.417782:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636163328:12345-0@lo:400:kworker.0 Request processed in 35us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034554.417789:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1786034554.417804:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1786034554.417810:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636163712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034554.417863:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636163712:12345-0@lo:400:kworker.0 Request processed in 53us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034554.417869:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1786034554.417886:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034554.417902:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636163712:0@lo:400:kworker.0 00000100:00100000:1.0:1786034554.417955:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636163328:0@lo:400:kworker.0 00000100:00100000:1.0:1786034554.417966:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636163840:0@lo:400:kworker.0 00000100:00100000:0.0:1786034554.418225:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636163456:12345-0@lo:400:kworker.0 Request processed in 1314us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034554.418234:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1786034554.418357:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636163200 00000100:00100000:3.0:1786034554.418362:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636163200 00000100:00100000:3.0:1786034554.418402:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1786034554.418409:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636163200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034554.418450:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636163200:12345-0@lo:400:kworker.0 Request processed in 42us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034554.418456:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1786034554.418499:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636163200:0@lo:400:kworker.0 00000100:00100000:2.0:1786034554.418650:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786034554.418661:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636163968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034554.418696:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034554.418852:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636163456:0@lo:400:kworker.0 00000100:00100000:3.0:1786034554.419630:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636163968 00000100:00100000:3.0:1786034554.419637:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636163968 00000100:00100000:3.0:1786034554.419683:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786034554.419691:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457db83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636163968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786034554.419739:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034554.419799:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457db83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636163968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034554.419807:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786034554.420377:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636163968:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786034554.544661:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034555.569395:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034556.592573:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034556.771003:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034556.771049:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034556.771080:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034556.771115:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034556.771197:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608860160 00000100:00100000:3.0:1786034556.771210:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608860160 00000100:00100000:3.0:1786034556.771286:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608860416 00000100:00100000:3.0:1786034556.771306:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608860416 00000100:00100000:3.0:1786034556.771350:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 152 00000100:00100000:3.0:1786034556.771362:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2364:x1872792608860160:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034556.771455:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2364:x1872792608860160:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 95us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034556.771462:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 152 00000100:00100000:3.0:1786034556.771479:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 153 00000100:00100000:3.0:1786034556.771485:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608860416:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034556.771506:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608860416:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 22us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034556.771512:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 153 00000100:00100000:1.0:1786034556.771699:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608860288 00000100:00100000:1.0:1786034556.771705:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608860288 00000100:00100000:1.0:1786034556.771757:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 68 00000100:00100000:1.0:1786034556.771764:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2364:x1872792608860288:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034556.771794:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2364:x1872792608860288:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 31us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034556.771801:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 68 00000100:00100000:2.0:1786034556.772105:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608860032 00000100:00100000:2.0:1786034556.772111:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608860032 00000100:00100000:2.0:1786034556.772155:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 296 00000100:00100000:2.0:1786034556.772163:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608860032:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034556.772192:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608860032:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 30us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034556.772199:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 296 00000100:00080000:0.0:1786034556.773429:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786034556.773436:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034557.488276:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636164096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786034557.488371:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034557.488722:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636164096 00000100:00100000:2.0:1786034557.488736:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636164096 00000100:00100000:2.0:1786034557.488868:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1786034557.488883:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636164096:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786034557.489124:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1786034557.489212:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034557.489301:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636164096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 422us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034557.489309:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1786034557.489392:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d659180 x1872792636164096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034557.489426:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636164096:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786034557.616022:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034558.643084:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034559.536574:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636164224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034559.536664:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034559.536945:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636164480:0@lo:400:kworker.0 00000100:00100000:1.0:1786034559.536984:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034559.537007:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1786034559.537013:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636164352:0@lo:400:kworker.0 00000100:00100000:1.0:1786034559.537045:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034559.537068:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636164864:0@lo:400:kworker.0 00000100:00100000:1.0:1786034559.537090:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034559.537119:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636164352 00000100:00100000:1.0:1786034559.537128:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636164352 00000100:00100000:1.0:1786034559.537183:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1786034559.537193:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636164352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034559.537244:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636164352:12345-0@lo:400:kworker.0 Request processed in 52us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034559.537251:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1786034559.537286:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636164608:0@lo:400:kworker.0 00000100:00100000:1.0:1786034559.537309:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034559.537326:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786034559.537331:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636164736:0@lo:400:kworker.0 00000100:00100000:1.0:1786034559.537354:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034559.537379:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636164480 00000100:00100000:1.0:1786034559.537383:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636164480 00000100:00100000:1.0:1786034559.537419:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636164864 00000100:00100000:1.0:1786034559.537422:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636164864 00000100:00100000:1.0:1786034559.537444:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636164608 00000100:00100000:1.0:1786034559.537446:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636164608 00000100:00100000:1.0:1786034559.537484:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1786034559.537489:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636164480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034559.537520:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636164480:12345-0@lo:400:kworker.0 Request processed in 31us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034559.537527:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1786034559.537537:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1786034559.537543:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636164864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034559.537564:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636164864:12345-0@lo:400:kworker.0 Request processed in 22us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034559.537570:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1786034559.537579:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1786034559.537584:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636164608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034559.537608:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636164608:12345-0@lo:400:kworker.0 Request processed in 24us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034559.537614:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1786034559.537629:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636164736 00000100:00100000:1.0:1786034559.537633:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636164736 00000100:00100000:1.0:1786034559.537659:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786034559.537664:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636164736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034559.537703:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636164736:12345-0@lo:400:kworker.0 Request processed in 39us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034559.537709:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1786034559.537727:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034559.537733:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786034559.537763:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d1c1500 x1872792636164736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034559.537790:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636164736:0@lo:400:kworker.0 00000100:00100000:1.0:1786034559.537802:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636164608:0@lo:400:kworker.0 00000100:00100000:1.0:1786034559.537868:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636164352:0@lo:400:kworker.0 00000100:00100000:1.0:1786034559.537878:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455a5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636164864:0@lo:400:kworker.0 00000100:00100000:1.0:1786034559.537886:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636164480:0@lo:400:kworker.0 00000100:00100000:2.0:1786034559.538109:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636164224 00000100:00100000:2.0:1786034559.538114:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636164224 00000100:00100000:2.0:1786034559.538166:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1786034559.538174:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636164224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034559.538209:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034559.538252:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636164224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034559.538259:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1786034559.538289:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636164224:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1786034559.538521:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786034559.667238:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034560.688050:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786034560.880817:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786034561.713098:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034561.898248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034561.898320:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034561.898482:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608860672 00000100:00100000:2.0:1786034561.898493:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608860672 00000100:00100000:2.0:1786034561.898583:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 157 00000100:00100000:2.0:1786034561.898595:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2364:x1872792608860672:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034561.898698:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2364:x1872792608860672:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 105us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034561.898706:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 157 00000100:00080000:0.0:1786034561.898991:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034561.899057:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608860544 00000100:00100000:1.0:1786034561.899062:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608860544 00000100:00100000:1.0:1786034561.899103:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 298 00000100:00100000:1.0:1786034561.899110:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608860544:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034561.899144:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608860544:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 35us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034561.899151:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 298 00000100:00100000:0.0:1786034561.913353:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034561.913552:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608860928 00000100:00100000:3.0:1786034561.913565:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608860928 00000100:00100000:3.0:1786034561.913670:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 158 00000100:00100000:3.0:1786034561.913682:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608860928:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034561.913782:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608860928:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 102us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034561.913791:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 158 00000100:00080000:0.0:1786034561.914709:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034561.915916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034561.919164:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608860800 00000100:00100000:1.0:1786034561.919182:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608860800 00000100:00080000:1.0:1786034561.925981:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786034561.926053:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 19 00000100:00100000:0.0:1786034561.926069:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2361:x1872792608860800:12345-192.168.203.56@tcp:9:kworker.0 00000020:00000080:0.0:1786034561.926238:0:6721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fd78 00000100:00080000:0.0:1786034561.926250:0:6721:0:(import.c:65:import_set_state_nolock()) ffff9645751c9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786034561.926350:0:6721:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1786034561.926737:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+2:2361:x1872792608860800:12345-192.168.203.56@tcp:9:kworker.0 Request processed in 671us (10824us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034561.926746:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 19 00010000:00010000:1.0:1786034561.938074:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034562.609995:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636164992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034562.610091:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034562.610251:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636164992 00000100:00100000:2.0:1786034562.610261:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636164992 00000100:00100000:2.0:1786034562.610346:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1786034562.610358:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636164992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786034562.610399:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034562.610447:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636164992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034562.610469:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1786034562.610531:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786034562.610562:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d659180 x1872792636164992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034562.610589:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636164992:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786034562.739087:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034563.760031:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034564.657311:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786034564.657349:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636165120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034564.657441:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034564.657716:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636165120 00000100:00100000:2.0:1786034564.657726:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636165120 00000100:00100000:2.0:1786034564.657802:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1786034564.657812:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636165120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034564.657879:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034564.657931:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636165120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034564.657939:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1786034564.658035:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786034564.658221:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636165504:0@lo:400:kworker.0 00000100:00100000:0.0:1786034564.658258:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034564.658283:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786034564.658288:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455185b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636165376:0@lo:400:kworker.0 00000100:00100000:0.0:1786034564.658308:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034564.658375:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455185b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636165632:0@lo:400:kworker.0 00000100:00100000:1.0:1786034564.658408:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034564.658445:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786034564.658451:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455185b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636165248:0@lo:400:kworker.0 00000100:00100000:1.0:1786034564.658479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034564.658497:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636165760:0@lo:400:kworker.0 00000100:00100000:1.0:1786034564.658518:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034564.658550:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636165248 00000100:00100000:1.0:1786034564.658554:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636165248 00000100:00100000:1.0:1786034564.658584:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1786034564.658590:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636165248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034564.658627:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636165248:12345-0@lo:400:kworker.0 Request processed in 36us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034564.658643:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1786034564.658692:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455185b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636165248:0@lo:400:kworker.0 00000100:00100000:3.0:1786034564.659149:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636165504 00000100:00100000:3.0:1786034564.659154:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636165504 00000100:00100000:3.0:1786034564.659197:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636165376 00000100:00100000:3.0:1786034564.659199:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636165376 00000100:00100000:3.0:1786034564.659228:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636165760 00000100:00100000:3.0:1786034564.659230:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636165760 00000100:00100000:3.0:1786034564.659243:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1786034564.659248:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636165504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034564.659287:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636165504:12345-0@lo:400:kworker.0 Request processed in 39us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034564.659294:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1786034564.659305:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1786034564.659311:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636165376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034564.659332:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636165376:12345-0@lo:400:kworker.0 Request processed in 22us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034564.659338:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1786034564.659359:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1786034564.659365:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636165760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034564.659393:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636165760:12345-0@lo:400:kworker.0 Request processed in 29us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034564.659399:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1786034564.659518:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455185b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636165376:0@lo:400:kworker.0 00000100:00100000:3.0:1786034564.659536:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636165504:0@lo:400:kworker.0 00000100:00100000:3.0:1786034564.659569:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636165120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034564.659590:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636165760:0@lo:400:kworker.0 00000100:00100000:0.0:1786034564.659698:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636165632 00000100:00100000:0.0:1786034564.659702:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636165632 00000100:00100000:0.0:1786034564.659741:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786034564.659748:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636165632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034564.659794:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636165632:12345-0@lo:400:kworker.0 Request processed in 46us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034564.659801:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1786034564.659858:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96455185b480 x1872792636165632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034564.659871:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455185b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636165632:0@lo:400:kworker.0 00000100:00080000:1.0:1786034564.661049:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034564.661056:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786034564.784227:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034565.813174:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786034565.839981:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 696d4f9b-62ce-40a0-a754-08fa96a026cd 00000020:00000080:0.0:1786034565.839993:0:7682:0:(genops.c:906:class_export_put()) final put ffff9645751ce800/696d4f9b-62ce-40a0-a754-08fa96a026cd 00000020:00000080:1.0:1786034565.840063:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9645751ce800/696d4f9b-62ce-40a0-a754-08fa96a026cd for lustre-OST0001 00000020:00000080:1.0:1786034565.840121:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9645751c9800 for lustre-OST0001 00010000:00010000:2.0:1786034566.834732:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034567.006278:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034567.006382:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034567.006425:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034567.010319:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608861312 00000100:00100000:3.0:1786034567.010336:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608861312 00000100:00100000:3.0:1786034567.010438:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608861184 00000100:00100000:3.0:1786034567.010442:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608861184 00000100:00100000:3.0:1786034567.010502:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 162 00000100:00100000:3.0:1786034567.010524:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2365:x1872792608861312:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034567.010632:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2365:x1872792608861312:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 121us (4249us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034567.010648:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 162 00000100:00100000:3.0:1786034567.010669:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 163 00000100:00100000:3.0:1786034567.010675:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2365:x1872792608861184:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034567.010700:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2365:x1872792608861184:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 25us (4275us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034567.010706:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 163 00000100:00080000:2.0:1786034567.012612:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034567.015959:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608861056 00000100:00100000:0.0:1786034567.015976:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608861056 00000100:00100000:0.0:1786034567.016050:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 300 00000100:00100000:0.0:1786034567.016061:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2365:x1872792608861056:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034567.016211:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2365:x1872792608861056:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 151us (9943us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034567.016219:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 300 00000100:00100000:0.0:1786034567.728314:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786034567.746272:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636165888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786034567.746538:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034567.747561:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636165888 00000100:00100000:3.0:1786034567.747571:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636165888 00000100:00100000:3.0:1786034567.747680:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786034567.747692:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636165888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786034567.747739:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034567.747818:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636165888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1280us total) trans 0 rc 0/0 00000100:00080000:2.0:1786034567.748009:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786034567.748175:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1786034567.759128:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d65aa00 x1872792636165888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034567.759164:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636165888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786034567.856071:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034568.879970:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034569.778873:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636166016:0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.778941:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034569.778979:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636166528:0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779001:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034569.779022:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786034569.779027:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455185b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636166400:0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779045:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034569.779068:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636166144:0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779098:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034569.779113:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636166656:0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779130:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034569.779143:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786034569.779147:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d1c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636166272:0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779163:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034569.779187:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636166016 00000100:00100000:1.0:1786034569.779193:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636166016 00000100:00100000:1.0:1786034569.779232:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1786034569.779239:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636166016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779277:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636166016:12345-0@lo:400:kworker.0 Request processed in 38us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034569.779297:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1786034569.779323:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636166528 00000100:00100000:1.0:1786034569.779326:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636166528 00000100:00100000:1.0:1786034569.779352:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636166144 00000100:00100000:1.0:1786034569.779354:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636166144 00000100:00100000:1.0:1786034569.779362:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636166272 00000100:00100000:1.0:1786034569.779364:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636166272 00000100:00100000:1.0:1786034569.779374:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1786034569.779379:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636166528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779404:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636166528:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034569.779409:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1786034569.779417:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1786034569.779422:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636166144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779442:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636166144:12345-0@lo:400:kworker.0 Request processed in 20us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034569.779447:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1786034569.779455:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1786034569.779459:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636166272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779477:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636166272:12345-0@lo:400:kworker.0 Request processed in 18us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034569.779482:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1786034569.779494:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636166400 00000100:00100000:1.0:1786034569.779508:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636166400 00000100:00100000:1.0:1786034569.779530:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636166656 00000100:00100000:1.0:1786034569.779532:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636166656 00000100:00100000:1.0:1786034569.779547:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1786034569.779558:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636166400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779584:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636166400:12345-0@lo:400:kworker.0 Request processed in 27us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034569.779589:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1786034569.779610:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1786034569.779616:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636166656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779636:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636166656:12345-0@lo:400:kworker.0 Request processed in 21us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034569.779641:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1786034569.779664:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786034569.779667:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034569.779669:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034569.779695:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636166272:0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779704:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636166144:0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779711:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636166656:0@lo:400:kworker.0 00010000:00080000:1.0:1786034569.779739:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96455185b480 x1872792636166400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034569.779749:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455185b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636166400:0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779755:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d1c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636166016:0@lo:400:kworker.0 00000100:00100000:1.0:1786034569.779762:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636166528:0@lo:400:kworker.0 00000100:00100000:3.0:1786034569.783484:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636166784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034569.783555:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034569.786268:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636166784 00000100:00100000:2.0:1786034569.786279:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636166784 00000100:00100000:2.0:1786034569.786350:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1786034569.786360:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636166784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034569.786395:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034569.791669:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636166784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5301us (8105us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034569.791684:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786034569.799622:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636166784:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786034569.907423:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786034570.098063:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786034570.929384:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034571.952159:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034572.130265:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034572.130311:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034572.130367:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034572.131181:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608861440 00000100:00100000:3.0:1786034572.131192:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608861440 00000100:00100000:3.0:1786034572.131250:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 302 00000100:00100000:3.0:1786034572.131260:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2365:x1872792608861440:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034572.131337:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2365:x1872792608861440:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 78us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034572.131346:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 302 00000100:00100000:0.0:1786034572.132695:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608861568 00000100:00100000:0.0:1786034572.132701:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608861568 00000100:00100000:3.0:1786034572.132863:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608861696 00000100:00100000:3.0:1786034572.132868:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608861696 00000100:00100000:3.0:1786034572.132895:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 167 00000100:00100000:3.0:1786034572.132903:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2365:x1872792608861568:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034572.132948:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2365:x1872792608861568:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 46us (2702us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034572.132955:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 167 00000100:00100000:3.0:1786034572.132968:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 168 00000100:00100000:3.0:1786034572.132974:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2365:x1872792608861696:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034572.133085:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2365:x1872792608861696:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 24us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034572.133093:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 168 00000100:00080000:2.0:1786034572.133339:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034572.848076:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636166912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034572.848156:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034572.850911:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636166912 00000100:00100000:0.0:1786034572.850924:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636166912 00000100:00100000:0.0:1786034572.851006:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1786034572.851017:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636166912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034572.851053:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034572.851168:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636166912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (3012us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034572.851187:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1786034572.851232:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d659f80 x1872792636166912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034572.851252:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636166912:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786034572.851506:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786034572.976209:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034574.006869:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786034574.430223:0:11893:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:42:51 (1786034571) 00000100:00100000:2.0:1786034574.896328:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636167296:0@lo:400:kworker.0 00000100:00100000:2.0:1786034574.896410:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034574.896479:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1786034574.896486:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636167168:0@lo:400:kworker.0 00000100:00100000:2.0:1786034574.896506:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034574.896522:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636167680:0@lo:400:kworker.0 00000100:00100000:2.0:1786034574.896544:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034574.896900:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636167296 00000100:00100000:2.0:1786034574.896911:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636167296 00000100:00100000:2.0:1786034574.896971:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636167168 00000100:00100000:2.0:1786034574.896974:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636167168 00000100:00100000:2.0:1786034574.897000:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1786034574.897011:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636167296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034574.897082:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636167296:12345-0@lo:400:kworker.0 Request processed in 73us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034574.897090:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1786034574.897109:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1786034574.897117:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636167168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034574.897147:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636167168:12345-0@lo:400:kworker.0 Request processed in 31us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034574.897152:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1786034574.897177:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636167680 00000100:00100000:2.0:1786034574.897181:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636167680 00000100:00100000:2.0:1786034574.897233:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1786034574.897240:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636167680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034574.897274:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636167680:12345-0@lo:400:kworker.0 Request processed in 34us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034574.897280:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1786034574.897309:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786034574.897315:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034574.897359:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636167168:0@lo:400:kworker.0 00000100:00100000:2.0:1786034574.897371:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636167680:0@lo:400:kworker.0 00000100:00100000:2.0:1786034574.897381:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636167296:0@lo:400:kworker.0 00000100:00100000:0.0:1786034574.897472:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636167424:0@lo:400:kworker.0 00000100:00100000:0.0:1786034574.897507:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034574.897544:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786034574.897550:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636167040:0@lo:400:kworker.0 00000100:00100000:0.0:1786034574.897599:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034574.897621:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636167552:0@lo:400:kworker.0 00000100:00100000:0.0:1786034574.897641:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034574.897803:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636167040 00000100:00100000:1.0:1786034574.897808:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636167040 00000100:00100000:1.0:1786034574.897864:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1786034574.897873:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636167040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034574.897914:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636167040:12345-0@lo:400:kworker.0 Request processed in 43us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034574.897921:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1786034574.897954:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636167040:0@lo:400:kworker.0 00000100:00100000:2.0:1786034574.898257:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636167424 00000100:00100000:2.0:1786034574.898263:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636167424 00000100:00100000:2.0:1786034574.898311:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1786034574.898319:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636167424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034574.898361:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636167424:12345-0@lo:400:kworker.0 Request processed in 43us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034574.898367:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1786034574.898400:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574c95180 x1872792636167424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786034590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034574.898412:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636167424:0@lo:400:kworker.0 00000100:00100000:2.0:1786034574.898428:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636167552 00000100:00100000:2.0:1786034574.898432:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636167552 00000100:00100000:2.0:1786034574.898458:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1786034574.898464:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636167552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034574.898498:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872792636167552:12345-0@lo:400:kworker.0 Request processed in 34us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034574.898512:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1786034574.898542:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636167552:0@lo:400:kworker.0 00000100:00080000:0.0:1786034574.900787:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786034574.900798:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786034574.902324:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636167808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034574.902401:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034574.906000:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636167808 00000100:00100000:3.0:1786034574.906015:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636167808 00000100:00100000:2.0:1786034574.906165:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1786034574.906177:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636167808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034574.906228:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034574.906323:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636167808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (3922us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034574.906332:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786034574.906468:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636167808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786034575.024000:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034576.051398:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034576.631999:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034576.632095:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608861824 00000100:00100000:0.0:1786034576.632105:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608861824 00000100:00100000:0.0:1786034576.632178:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 32 00000100:00100000:0.0:1786034576.632190:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:10249:x1872792608861824:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786034576.632208:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034576.632229:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af3fe43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758620 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034576.632285:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af3fe4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034576.632313:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af3fe4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034576.632324:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af3fe4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034576.632501:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1786034576.632506:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034576.632605:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af3fe4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034576.632630:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af3fe43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758620 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034576.632648:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af3fe4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758620 expref: 6 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034576.632656:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4d00) 00010000:00010000:0.0:1786034576.632659:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034576.632663:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8600, rc 0) 00000100:00080000:2.0:1786034576.632744:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034576.632918:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:10249:x1872792608861824:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 731us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034576.632925:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 32 00000100:00100000:3.0:1786034576.665684:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034576.665754:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608861952 00000100:00100000:2.0:1786034576.665763:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608861952 00000100:00100000:2.0:1786034576.665839:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 33 00000100:00100000:2.0:1786034576.665849:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:10250:x1872792608861952:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786034576.665869:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034576.666054:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af3fe51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758627 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666118:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af3fe58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666133:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af3fe58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666160:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af3fe58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666175:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af3fe5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666182:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af3fe5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666189:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af3fe5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666591:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6800/0x490975051af3fe66 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666600:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6800/0x490975051af3fe66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666606:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6800/0x490975051af3fe66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034576.666736:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1786034576.666740:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1786034576.666849:0:5861:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6800/0x490975051af3fe66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666860:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af3fe58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666866:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af3fe58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666935:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af3fe58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666941:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034576.666945:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af3fe58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666952:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af3fe58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666964:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4d00) 00010000:00010000:2.0:1786034576.666967:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034576.666970:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af3fe58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.666977:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af3fe58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.667042:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af3fe5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.667049:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af3fe5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.667055:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af3fe5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.667060:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034576.667063:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af3fe5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.667079:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af3fe5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.667087:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff96455a530e00) 00010000:00010000:2.0:1786034576.667090:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034576.667092:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af3fe5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.667097:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af3fe5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.667126:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af3fe51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758627 expref: 8 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.667140:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6800/0x490975051af3fe66 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758627 expref: 7 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034576.667147:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96455a530000) 00010000:00010000:2.0:1786034576.667150:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786034576.667152:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6800, rc 0) 00000100:00100000:2.0:1786034576.667260:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:10250:x1872792608861952:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 1412us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034576.667268:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 33 00000100:00100000:3.0:1786034576.675942:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034576.676067:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608862208 00000100:00100000:1.0:1786034576.676076:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608862208 00000100:00100000:1.0:1786034576.676172:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 34 00000100:00100000:1.0:1786034576.676183:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:10250:x1872792608862208:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786034576.676202:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034576.676220:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af3fe6d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75862e expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.676284:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af3fe74 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.676296:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af3fe74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.676307:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af3fe74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.676342:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fe7b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.676350:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fe7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.676357:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fe7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.676885:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fe82 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.676894:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fe82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.676902:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fe82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034576.676911:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1786034576.678570:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af3fe74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.678583:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af3fe74 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.678590:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af3fe74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.678596:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034576.678601:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af3fe74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.678621:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af3fe74 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.678635:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96455a530000) 00010000:00010000:1.0:1786034576.678638:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034576.678643:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af3fe74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.678649:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af3fe74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.678660:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fe7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.680791:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fe7b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.680801:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fe7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.680807:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034576.680811:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fe7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.680819:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fe7b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.680843:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9645521d1300) 00010000:00010000:1.0:1786034576.680846:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034576.680849:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fe7b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.680881:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af3fe7b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.682257:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af3fe6d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75862e expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.682278:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fe82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75862e expref: 9 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034576.682285:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9645521d1700) 00010000:00010000:1.0:1786034576.682288:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034576.682290:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01800, rc 0) 00000100:00100000:1.0:1786034576.683440:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:10250:x1872792608862208:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 7256us (7503us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1786034576.683450:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 34 00000100:00100000:1.0:1786034576.700078:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034576.700768:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608862336 00000100:00100000:0.0:1786034576.700777:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608862336 00000100:00100000:0.0:1786034576.700860:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 35 00000100:00100000:0.0:1786034576.700870:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:10250:x1872792608862336:12345-192.168.203.56@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1786034576.700995:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:10250:x1872792608862336:12345-192.168.203.56@tcp:59:lhsmtool_posix.0 Request processed in 118us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034576.701016:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 35 00010000:00010000:1.0:1786034577.073969:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034577.245384:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034577.245461:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034577.245520:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034577.245575:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608862592 00000100:00100000:3.0:1786034577.245586:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608862592 00000100:00100000:2.0:1786034577.245600:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608862464 00000100:00100000:2.0:1786034577.245607:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608862464 00000100:00100000:2.0:1786034577.245653:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 304 00000100:00100000:2.0:1786034577.245662:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608862464:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034577.245751:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608862464:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 90us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034577.245760:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 304 00000100:00100000:3.0:1786034577.245802:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608862720 00000100:00100000:3.0:1786034577.245806:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608862720 00000100:00100000:3.0:1786034577.245877:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 172 00000100:00100000:3.0:1786034577.245886:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2364:x1872792608862592:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034577.245923:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2364:x1872792608862592:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 38us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034577.245929:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 172 00000100:00100000:3.0:1786034577.245943:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 173 00000100:00100000:3.0:1786034577.245949:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608862720:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034577.245972:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608862720:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 24us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034577.245978:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 173 00000100:00080000:2.0:1786034577.248376:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1786034577.264676:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1786034577.968171:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636167936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034577.968254:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034577.968373:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636167936 00000100:00100000:3.0:1786034577.968382:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636167936 00000100:00100000:3.0:1786034577.968453:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1786034577.968464:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636167936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786034577.968503:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034577.968570:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636167936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034577.968576:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1786034577.968623:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96457d65b800 x1872792636167936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034577.968644:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636167936:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786034577.968703:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786034578.107883:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034579.120075:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034579.147310:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034579.148058:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608862848 00000100:00100000:0.0:1786034579.148071:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608862848 00000100:00100000:0.0:1786034579.148198:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 36 00000100:00100000:0.0:1786034579.148218:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:10292:x1872792608862848:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034579.148250:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034579.148277:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af3fe90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758635 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148354:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fe97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148370:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fe97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148381:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fe97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148395:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fe9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148403:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fe9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148409:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fe9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148697:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fe97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148714:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fe97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148721:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fe97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148729:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034579.148733:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fe97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148742:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fe97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148767:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4d00) 00010000:00010000:0.0:1786034579.148770:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034579.148775:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fe97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148781:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fe97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148793:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fe9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148800:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fe9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148806:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fe9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148811:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034579.148819:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fe9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148845:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fe9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148853:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff964547ee4c00) 00010000:00010000:0.0:1786034579.148856:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034579.148859:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fe9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.148864:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fe9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786034579.150480:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786034579.150574:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af3fe90 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758635 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.150593:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4d00) 00010000:00010000:0.0:1786034579.150596:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034579.150601:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af3fe90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758635 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.150613:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8c00, rc 0) 00000100:00100000:0.0:1786034579.150698:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:10292:x1872792608862848:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 2483us (3397us total) trans 0 rc 301/301 00000100:00100000:0.0:1786034579.150708:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 36 00000100:00100000:2.0:1786034579.157918:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034579.160320:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608863104 00000100:00100000:3.0:1786034579.160341:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608863104 00000100:00100000:3.0:1786034579.160417:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 37 00000100:00100000:3.0:1786034579.160430:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:10292:x1872792608863104:12345-192.168.203.56@tcp:36:lfs.0 00010000:00010000:3.0:1786034579.160502:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034579.160549:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af3fe4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758620 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.160571:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4d00) 00010000:00010000:3.0:1786034579.160584:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034579.160955:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fea5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.160971:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fea5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.160982:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fea5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.160995:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3feac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.161014:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3feac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.161022:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3feac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034579.167457:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1786034579.167480:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fea5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.167491:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fea5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.167506:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fea5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.167513:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034579.167517:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fea5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.167526:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fea5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.167560:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119e00) 00010000:00010000:3.0:1786034579.167563:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034579.167569:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fea5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.167576:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3fea5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786034579.167596:0:5863:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000a634885d reply state 000000006d357f53 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3feac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034579.167606:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786034579.167743:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:10292:x1872792608863104:12345-192.168.203.56@tcp:36:lfs.0 Request processed in 7311us (9830us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1786034579.167764:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 37 00010000:00010000:3.0:1786034579.174196:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3feac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.174217:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3feac lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.175100:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3feac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.175108:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034579.175113:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3feac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.175123:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3feac lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.175143:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff96454a119600) 00010000:00010000:3.0:1786034579.175146:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034579.175151:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3feac lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.175158:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3feac lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034579.287702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034579.293916:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608863232 00000100:00100000:3.0:1786034579.293935:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608863232 00000100:00100000:3.0:1786034579.294038:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 38 00000100:00100000:3.0:1786034579.294051:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:10300:x1872792608863232:12345-192.168.203.56@tcp:101:lctl.0 00010000:00010000:3.0:1786034579.294084:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034579.294114:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3feb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75863c expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.294194:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3feba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.294390:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3feba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.294405:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3feba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034579.294479:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786034579.294484:0:6743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1786034579.294545:0:6743:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3feba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.294574:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3feb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75863c expref: 11 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.294593:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3feba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75863c expref: 10 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.294602:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119600) 00010000:00010000:3.0:1786034579.294605:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786034579.294609:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312a00, rc 0) 00000100:00100000:3.0:1786034579.294694:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:10300:x1872792608863232:12345-192.168.203.56@tcp:101:lctl.0 Request processed in 647us (7006us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034579.294702:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 38 00000100:00100000:0.0:1786034579.402066:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034579.402106:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608863360 00000100:00100000:0.0:1786034579.402117:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608863360 00000100:00100000:0.0:1786034579.402174:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 39 00000100:00100000:0.0:1786034579.402196:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:10306:x1872792608863360:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:0.0:1786034579.402220:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034579.402244:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af3fec1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758643 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402316:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fec8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402331:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fec8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402342:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fec8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402357:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fecf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402363:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fecf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402369:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fecf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402491:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8000/0x490975051af3fed6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402498:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8000/0x490975051af3fed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402505:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8000/0x490975051af3fed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034579.402561:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1786034579.402565:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034579.402605:0:5861:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8000/0x490975051af3fed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402619:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fec8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402625:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fec8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402632:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fec8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402637:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034579.402642:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fec8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402649:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fec8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402662:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119600) 00010000:00010000:0.0:1786034579.402665:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034579.402669:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fec8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402675:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3fec8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402685:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fecf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402699:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fecf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402705:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fecf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402710:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034579.402712:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fecf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402717:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fecf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402724:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff964547ee4c00) 00010000:00010000:0.0:1786034579.402726:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034579.402729:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fecf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402734:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af3fecf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402764:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af3fec1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758643 expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402776:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8000/0x490975051af3fed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758643 expref: 11 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.402783:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:0.0:1786034579.402785:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786034579.402793:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8000, rc 0) 00000100:00100000:0.0:1786034579.402871:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+11:10306:x1872792608863360:12345-192.168.203.56@tcp:101:bash.0 Request processed in 676us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034579.402879:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 39 00000100:00100000:0.0:1786034579.416445:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034579.416486:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608863616 00000100:00100000:0.0:1786034579.416496:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608863616 00000100:00100000:0.0:1786034579.416568:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 40 00000100:00100000:0.0:1786034579.416579:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+11:10306:x1872792608863616:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:0.0:1786034579.416603:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034579.416625:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af3fedd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75864a expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.416812:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af3fee4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.416845:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af3fee4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.416859:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af3fee4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.416874:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af3feeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.416881:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af3feeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.416975:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af3feeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786034579.417634:0:6743:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1786034579.419098:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af3fef2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.419116:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af3fef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.419127:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af3fef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.419179:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af3fee4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.419186:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af3fee4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.419193:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af3fee4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.419199:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034579.419203:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af3fee4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.419211:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af3fee4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.419224:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:0.0:1786034579.419227:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034579.419231:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af3fee4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.419248:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af3fee4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786034579.419264:0:6743:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000045510a15 reply state 0000000008a99eb5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af3feeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034579.419273:0:6743:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786034579.419309:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af3fedd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75864a expref: 14 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.419322:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af3fef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75864a expref: 13 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.419330:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034579.419333:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786034579.419335:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8e00, rc 0) 00000100:00100000:0.0:1786034579.419417:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:10306:x1872792608863616:12345-192.168.203.56@tcp:101:bash.0 Request processed in 2840us (2984us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1786034579.419426:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 40 00010000:00010000:0.0:1786034579.425298:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af3feeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.425314:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af3feeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.425333:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af3feeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.425340:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034579.425352:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af3feeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.425361:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af3feeb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.425380:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff964547ee4800) 00010000:00010000:0.0:1786034579.425384:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034579.425389:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af3feeb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.425395:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af3feeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034579.435273:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034579.435628:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608863744 00000100:00100000:2.0:1786034579.435640:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608863744 00000100:00100000:2.0:1786034579.435685:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00100000:2.0:1786034579.435694:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1872792608863744:12345-192.168.203.56@tcp:8:bash.0 00010000:00080000:2.0:1786034579.435733:0:8676:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:2.0:1786034579.435844:0:8676:0:(genops.c:1406:class_connect()) connect: client 696d4f9b-62ce-40a0-a754-08fa96a026cd, cookie 0x490975051af3ff00 00002000:00100000:2.0:1786034579.435860:0:8676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 696d4f9b-62ce-40a0-a754-08fa96a026cd/ffff964574733800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113834 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786034579.435872:0:8676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786034579.436284:0:8676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786034579.436315:0:8676:0:(import.c:65:import_set_state_nolock()) ffff964574736000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786034579.436389:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2361:x1872792608863744:12345-192.168.203.56@tcp:8:bash.0 Request processed in 696us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034579.436398:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00100000:0.0:1786034579.438275:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034579.438404:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608863872 00000100:00100000:2.0:1786034579.438413:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608863872 00000100:00080000:1.0:1786034579.439426:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786034579.439498:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 21 00000100:00100000:2.0:1786034579.439511:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:0:x1872792608863872:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:2.0:1786034579.439539:0:6720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034579.439565:0:6720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d3ea496/0x490975051af3ff07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758651 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786034579.439596:0:6720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786034579.439617:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1786034579.439622:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034579.439632:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d3ea496/0x490975051af3ff07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758651 expref: 7 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034579.439655:0:6720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d3ea496/0x490975051af3ff07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758651 expref: 7 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034579.439670:0:6720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7200, rc 0) 00000100:00100000:2.0:1786034579.439718:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:0:x1872792608863872:12345-192.168.203.56@tcp:101:bash.0 Request processed in 211us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034579.439725:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 21 00000100:00100000:0.0:1786034579.442616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034579.442708:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608864000 00000100:00100000:1.0:1786034579.442718:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608864000 00000100:00100000:1.0:1786034579.442783:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:1.0:1786034579.442793:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:10306:x1872792608864000:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:1.0:1786034579.442810:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034579.442859:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758658 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034579.443004:0:8676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d3ea496/0x490975051af3ff07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758651 expref: 8 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034579.443016:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034579.443020:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034579.443026:0:8676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 8 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034579.443065:0:8676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d3ea496/0x490975051af3ff07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758651 expref: 8 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034579.443080:0:8676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d3ea496/0x490975051af3ff07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758651 expref: 8 pid: 6720 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034579.443098:0:8676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1872792636168064:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034579.443196:0:8676:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454ac91a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786034579.445674:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034579.445735:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608864128 00000100:00100000:2.0:1786034579.445743:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608864128 00010000:00010000:2.0:1786034579.445784:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d3ea496/0x490975051af3ff07 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758651 expref: 9 pid: 6720 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034579.445840:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 35 00000100:00100000:2.0:1786034579.445850:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2362:x1872792608864128:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034579.445876:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034579.446002:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d3ea496/0x490975051af3ff07 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758651 expref: 9 pid: 6720 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034579.446027:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d3ea496/0x490975051af3ff07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758651 expref: 9 pid: 6720 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034579.446054:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034579.446059:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034579.446067:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 9 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034579.446077:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 9 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034579.446114:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 9 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034579.446128:0:5848:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c97480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5848:1872792636168192:192.168.203.56@tcp:105: 00000100:00100000:2.0:1786034579.446196:0:5848:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560bf7f00 going to sleep for 11 seconds 00010000:00010000:1.0:1786034579.446661:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d3ea496/0x490975051af3ff07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758651 expref: 9 pid: 6720 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034579.446675:0:8676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1872792636168064:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034579.446700:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 8 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034579.446710:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00c00, rc 0) 00000100:00100000:1.0:1786034579.446763:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:10306:x1872792608864000:12345-192.168.203.56@tcp:101:bash.0 Request processed in 3971us (4156us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034579.446770:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:2.0:1786034579.448949:0:5848:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c97480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5848:1872792636168192:192.168.203.56@tcp:105: 00010000:00010000:2.0:1786034579.448970:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034579.449008:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2362:x1872792608864128:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 3159us (3341us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034579.449018:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 35 00000100:00100000:3.0:1786034579.451252:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034579.451319:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608864384 00000100:00100000:1.0:1786034579.451329:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608864384 00000100:00100000:1.0:1786034579.451383:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 6 00000100:00100000:1.0:1786034579.451393:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:10306:x1872792608864384:12345-192.168.203.56@tcp:35:bash.0 00000100:00100000:1.0:1786034579.451940:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:10306:x1872792608864384:12345-192.168.203.56@tcp:35:bash.0 Request processed in 547us (695us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1786034579.451949:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 6 00000100:00100000:3.0:1786034579.524332:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034579.524518:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608864640 00000100:00100000:0.0:1786034579.524541:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608864640 00000100:00100000:0.0:1786034579.524620:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 41 00000100:00100000:0.0:1786034579.524632:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:10316:x1872792608864640:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034579.524661:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034579.524686:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af3ff15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75865f expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034579.525612:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1786034579.525768:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af3ff15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75865f expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034579.525787:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119600) 00010000:00010000:2.0:1786034579.525791:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786034579.525796:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af3ff15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75865f expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034579.525815:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8c00, rc 0) 00000100:00100000:2.0:1786034579.526133:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:10316:x1872792608864640:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 1501us (1813us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1786034579.526142:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 41 00000100:00100000:1.0:1786034579.528760:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034579.529014:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608864896 00000100:00100000:3.0:1786034579.529034:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608864896 00000100:00100000:3.0:1786034579.529127:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 7 00000100:00100000:3.0:1786034579.529139:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:10316:x1872792608864896:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:3.0:1786034579.529657:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:10316:x1872792608864896:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 519us (904us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1786034579.529665:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 7 00000100:00100000:0.0:1786034579.585284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034579.585387:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608865024 00000100:00100000:3.0:1786034579.585400:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608865024 00000100:00100000:3.0:1786034579.585475:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 42 00000100:00100000:3.0:1786034579.585487:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:10322:x1872792608865024:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034579.585520:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034579.585557:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af3ff23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758666 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.585643:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3ff2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.585660:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3ff2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.585672:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3ff2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034579.585739:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1786034579.585743:0:6743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786034579.585779:0:6743:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3ff2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.585807:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af3ff23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758666 expref: 18 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.585869:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3ff2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758666 expref: 17 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.585894:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:3.0:1786034579.585898:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786034579.585901:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562313600, rc 0) 00000100:00100000:3.0:1786034579.585961:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+17:10322:x1872792608865024:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 476us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034579.585968:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 42 00000100:00100000:0.0:1786034579.594282:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034579.594457:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608865280 00000100:00100000:3.0:1786034579.594468:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608865280 00000100:00100000:3.0:1786034579.594544:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 43 00000100:00100000:3.0:1786034579.594555:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+17:10322:x1872792608865280:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034579.594580:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034579.594604:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af3ff31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75866d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.594723:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af3ff38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.594738:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af3ff38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.594762:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af3ff38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034579.594775:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1786034579.594959:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af3ff31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75866d expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.595002:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af3ff38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75866d expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.595012:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:3.0:1786034579.595015:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034579.595031:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312200, rc 0) 00000100:00100000:3.0:1786034579.595094:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:10322:x1872792608865280:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 541us (824us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1786034579.595103:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 43 00000100:00100000:1.0:1786034579.598112:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034579.598249:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608865536 00000100:00100000:3.0:1786034579.598259:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608865536 00000100:00100000:3.0:1786034579.598320:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 44 00000100:00100000:3.0:1786034579.598330:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:10322:x1872792608865536:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034579.598356:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034579.598377:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af3ff46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758674 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.598476:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.598490:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.598502:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034579.598514:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1786034579.598660:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af3ff46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758674 expref: 22 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.598678:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758674 expref: 21 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.598687:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:3.0:1786034579.598690:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786034579.598693:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0800, rc 0) 00000100:00100000:3.0:1786034579.598765:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:10322:x1872792608865536:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 437us (665us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1786034579.598773:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 44 00000100:00100000:0.0:1786034579.604344:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034579.604390:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034579.604474:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608865792 00000100:00100000:2.0:1786034579.604486:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608865792 00000100:00100000:2.0:1786034579.604553:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 23 00000100:00100000:2.0:1786034579.604565:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2365:x1872792608865792:12345-192.168.203.56@tcp:1:lfs.0 00010000:00010000:2.0:1786034579.604617:0:6720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056f2704a/0x490975051af3ff5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034579.604640:0:6720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 7 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034579.604649:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034579.604654:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786034579.604659:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056f2704a/0x490975051af3ff5b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034579.604709:0:6720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 7 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034579.604724:0:6720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 7 pid: 8676 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034579.604740:0:6720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6720:1872792636168320:192.168.203.56@tcp:104: 00000100:00100000:2.0:1786034579.604870:0:6720:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560bf7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786034579.605323:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608865664 00000100:00100000:1.0:1786034579.605328:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608865664 00000100:00100000:1.0:1786034579.605372:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 2 00000100:00100000:1.0:1786034579.605380:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:2363:x1872792608865664:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034579.605392:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034579.605415:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af3ff38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75866d expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034579.605431:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:1.0:1786034579.605435:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034579.605473:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:2363:x1872792608865664:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 94us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034579.605481:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 2 00000100:00100000:0.0:1786034579.611294:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034579.611384:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608865920 00000100:00100000:1.0:1786034579.611411:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608865920 00002000:00100000:1.0:1786034579.611470:0:6725:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff964574d68000 x1872792608865920/t0(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:550/0 lens 504/0 e 0 to 0 dl 1786034590 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786034579.611484:0:6725:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574d68000 with x1872792608865920 ext(0->12) 00010000:00010000:1.0:1786034579.611495:0:6725:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 8 pid: 8676 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034579.611517:0:6725:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 8 pid: 8676 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786034579.611537:0:6725:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff964574d68000 00000100:00100000:1.0:1786034579.611575:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:1.0:1786034579.611585:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2362:x1872792608865920:12345-192.168.203.56@tcp:4:lfs.0 00000100:00100000:2.0:1786034579.613307:0:6720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6720:1872792636168320:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034579.613343:0:6720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056f2704a/0x490975051af3ff5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1786034579.706429:0:6746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 696d4f9b-62ce-40a0-a754-08fa96a026cd 00000100:00100000:2.0:1786034579.708771:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2362:x1872792608865920:12345-192.168.203.56@tcp:4:lfs.0 Request processed in 97174us (97473us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1786034579.708788:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 0 00002000:00100000:2.0:1786034579.708800:0:6725:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff964574d68000 x1872792608865920/t4294967299(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:550/0 lens 504/448 e 0 to 0 dl 1786034590 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786034579.708810:0:6725:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574d68000 with x1872792608865920 ext(0->12) 00010000:00010000:2.0:1786034579.708837:0:6725:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 9 pid: 8676 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034579.708855:0:6725:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 9 pid: 8676 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786034579.708876:0:6725:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff964574d68000 00000100:00100000:0.0:1786034579.720109:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034579.720687:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608866048 00000100:00100000:1.0:1786034579.720697:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608866048 00010000:00010000:1.0:1786034579.720735:0:7671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 9 pid: 8676 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034579.720911:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 36 00000100:00100000:1.0:1786034579.720921:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2365:x1872792608866048:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034579.720936:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786034579.720954:0:7671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1786034579.720957:0:7671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1786034578 00002000:00010000:1.0:1786034579.720960:0:7671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1786034578 00002000:00010000:1.0:1786034579.720962:0:7671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1786034578 00010000:00010000:1.0:1786034579.720968:0:7671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 9 pid: 8676 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034579.720996:0:7671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 9 pid: 8676 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034579.721020:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af3ff0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758658 expref: 9 pid: 8676 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034579.721036:0:7671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786034579.721041:0:7671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786034579.721046:0:7671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056f2704a/0x490975051af3ff5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034579.721056:0:7671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056f2704a/0x490975051af3ff5b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034579.721092:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034579.721151:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2365:x1872792608866048:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 230us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034579.721159:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 36 00010000:00010000:3.0:1786034579.721939:0:6720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056f2704a/0x490975051af3ff5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.721950:0:6720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056f2704a/0x490975051af3ff5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.721973:0:6720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056f2704a/0x490975051af3ff5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.721981:0:6720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056f2704a/0x490975051af3ff5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.721990:0:6720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056f2704a/0x490975051af3ff5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.722010:0:6720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7c00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:3.0:1786034579.722014:0:6720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056f2704a/0x490975051af3ff5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.722023:0:6720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056f2704a/0x490975051af3ff5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.722037:0:6720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056f2704a/0x490975051af3ff5b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.722045:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056f2704a/0x490975051af3ff5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034579.722104:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2365:x1872792608865792:12345-192.168.203.56@tcp:1:lfs.0 Request processed in 117541us (117712us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034579.722111:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 23 00000100:00100000:0.0:1786034579.727591:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034579.727672:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608866304 00000100:00100000:3.0:1786034579.727680:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608866304 00000100:00100000:3.0:1786034579.727731:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 8 00000100:00100000:3.0:1786034579.727740:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:10322:x1872792608866304:12345-192.168.203.56@tcp:35:lfs.0 00000004:00010000:3.0:1786034579.727796:0:5865:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758674 expref: 20 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786034579.728080:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1786034579.728124:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1786034579.728898:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1786034579.728954:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.728969:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af3fef2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75864a expref: 24 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.728977:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.729006:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af3fef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75864a expref: 24 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.729018:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af3fef2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75864a expref: 24 pid: 6743 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034579.729031:0:5865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d659180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5865:1872792636168448:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034579.729144:0:5865:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594cae40 going to sleep for 11 seconds 00000100:00100000:3.0:1786034579.749801:0:5865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d659180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5865:1872792636168448:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034579.749840:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00010000:00010000:3.0:1786034579.749864:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034579.749945:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608866432 00000100:00100000:0.0:1786034579.749952:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608866432 00010000:00010000:0.0:1786034579.749985:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af3fef2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75864a expref: 25 pid: 6743 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034579.750021:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 37 00000100:00100000:0.0:1786034579.750030:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+25:2363:x1872792608866432:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034579.750043:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034579.750050:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af3fef2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75864a expref: 25 pid: 6743 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.750062:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af3fef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75864a expref: 25 pid: 6743 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.750082:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af3fef2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75864a expref: 25 pid: 6743 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.750095:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034579.750100:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.750108:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.750116:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.750159:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034579.750214:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:2363:x1872792608866432:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 184us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034579.750221:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 37 00010000:00010000:3.0:1786034579.750421:0:5865:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.750429:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786034579.750556:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1786034579.751940:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1786034579.752044:0:5865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d69180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1872792636168576:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786034579.752132:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034579.752164:0:5865:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645595b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1786034579.752313:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636168576 00000100:00100000:3.0:1786034579.752328:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636168576 00000100:00100000:3.0:1786034579.752406:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786034579.752413:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5865:x1872792636168576:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1786034579.752491:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786034579.761810:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5865:x1872792636168576:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 9389us (9668us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034579.761838:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786034579.762689:0:5865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d69180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1872792636168576:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1786034579.766308:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1786034579.766398:0:5865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d69180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1872792636168704:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786034579.766463:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034579.766560:0:5865:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c751600 going to sleep for 11 seconds 00000100:00100000:2.0:1786034579.773847:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636168704 00000100:00100000:2.0:1786034579.773861:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636168704 00000100:00100000:2.0:1786034579.773913:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786034579.773922:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5865:x1872792636168704:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786034579.774332:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5865:x1872792636168704:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 411us (7869us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1786034579.774341:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786034579.782704:0:5865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d69180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1872792636168704:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1786034579.795737:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1786034579.795845:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.795857:0:5865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.795865:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.795871:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034579.795875:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.795883:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.795912:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034579.795916:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1786034579.795920:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034579.795926:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff62 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786034579.796117:0:5865:0:(mdd_object.c:4291:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1786034579.796466:0:5865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1786034579.796478:0:5865:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416004654196ns, next at 417004651623ns, rc = 0 00000001:00080000:0.0:1786034579.796485:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1786034579.796523:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034579.796537:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786034579.796546:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758674 expref: 28 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034579.797102:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:10322:x1872792608866304:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 69360us (69516us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1786034579.797112:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 8 00000020:00080000:0.0:1786034579.797118:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1786034579.803813:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034579.805317:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608866560 00000100:00100000:3.0:1786034579.805327:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608866560 00000100:00100000:3.0:1786034579.805386:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 45 00000100:00100000:3.0:1786034579.805396:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:10322:x1872792608866560:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034579.805418:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034579.805450:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3ff69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75867b expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.805508:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3ff69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75867b expref: 28 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.805521:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3ff69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75867b expref: 28 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.805549:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034579.805552:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786034579.805555:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f1c00, rc 0) 00000100:00100000:3.0:1786034579.805621:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+28:10322:x1872792608866560:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 226us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034579.805627:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 45 00000100:00100000:3.0:1786034579.809395:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034579.809489:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608866816 00000100:00100000:1.0:1786034579.809497:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608866816 00000100:00100000:1.0:1786034579.809555:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00100000:1.0:1786034579.809580:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542eee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+28:10322:x1872792608866816:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:1.0:1786034579.809776:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542eee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:10322:x1872792608866816:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 198us (389us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1786034579.809784:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00100000:1.0:1786034579.968887:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034579.968972:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608867072 00000100:00100000:3.0:1786034579.968981:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608867072 00000100:00100000:3.0:1786034579.969032:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 46 00000100:00100000:3.0:1786034579.969042:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:10333:x1872792608867072:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034579.969063:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034579.969082:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3ff70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758682 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034579.969195:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1786034579.969294:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3ff70 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758682 expref: 31 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.969309:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119600) 00010000:00010000:3.0:1786034579.969312:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786034579.969316:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3ff70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758682 expref: 31 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.969330:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0e00, rc 0) 00000100:00100000:3.0:1786034579.969382:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+30:10333:x1872792608867072:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 342us (504us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1786034579.969389:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 46 00000100:00100000:1.0:1786034579.972920:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034579.973005:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608867200 00000100:00100000:3.0:1786034579.973014:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608867200 00000100:00100000:3.0:1786034579.973066:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 47 00000100:00100000:3.0:1786034579.973076:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+30:10333:x1872792608867200:12345-192.168.203.56@tcp:34:lfs.0 00010000:00010000:3.0:1786034579.973143:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ff7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973176:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ff7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973190:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ff7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973207:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973214:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973220:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973311:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973321:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973327:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786034579.973366:0:5863:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973379:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ff7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973386:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ff7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973404:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ff7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973410:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034579.973413:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ff7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973420:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ff7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973431:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:3.0:1786034579.973434:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034579.973437:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ff7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973443:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ff7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973455:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973460:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973465:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973469:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034579.973472:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973485:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973493:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96454a119e00) 00010000:00010000:3.0:1786034579.973495:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034579.973497:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973502:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973517:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973522:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973538:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973542:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034579.973544:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973549:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973555:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034579.973557:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034579.973559:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034579.973583:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034579.973650:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+30:10333:x1872792608867200:12345-192.168.203.56@tcp:34:lfs.0 Request processed in 575us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034579.973658:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 47 00000100:00100000:2.0:1786034579.978007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034579.978077:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608867456 00000100:00100000:1.0:1786034579.978085:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608867456 00000100:00100000:1.0:1786034579.978131:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:1.0:1786034579.978140:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+30:10333:x1872792608867456:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:1.0:1786034579.978370:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:10333:x1872792608867456:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 230us (382us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1786034579.978378:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:3.0:1786034580.016847:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034580.016870:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964551858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636168832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034580.016939:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034580.017061:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636168832 00000100:00100000:1.0:1786034580.017069:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636168832 00000100:00100000:1.0:1786034580.017135:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1786034580.017146:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636168832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786034580.017180:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034580.017228:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636168832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034580.017235:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1786034580.017279:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964551858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636168832:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1786034580.017550:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786034580.018695:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636169344:0@lo:400:kworker.0 00000100:00100000:0.0:1786034580.018734:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034580.018772:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786034580.018778:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636169216:0@lo:400:kworker.0 00000100:00100000:0.0:1786034580.018804:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034580.019025:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636168960:0@lo:400:kworker.0 00000100:00100000:3.0:1786034580.019057:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034580.019074:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636169472:0@lo:400:kworker.0 00000100:00100000:3.0:1786034580.019093:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034580.019125:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786034580.019130:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636169088:0@lo:400:kworker.0 00000100:00100000:3.0:1786034580.019146:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034580.019169:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636169344 00000100:00100000:3.0:1786034580.019189:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636169344 00000100:00100000:3.0:1786034580.019234:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1786034580.019240:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1872792636169344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034580.019278:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1872792636169344:12345-0@lo:400:kworker.0 Request processed in 37us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034580.019285:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1786034580.019302:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636169216 00000100:00100000:3.0:1786034580.019305:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636169216 00000100:00100000:3.0:1786034580.019324:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636169472 00000100:00100000:3.0:1786034580.019337:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636169472 00000100:00100000:3.0:1786034580.019361:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636169088 00000100:00100000:3.0:1786034580.019364:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636169088 00000100:00100000:3.0:1786034580.019374:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1786034580.019379:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636169216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034580.019406:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636169216:12345-0@lo:400:kworker.0 Request processed in 26us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034580.019410:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1786034580.019429:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1786034580.019434:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636169472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034580.019476:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636169472:12345-0@lo:400:kworker.0 Request processed in 42us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034580.019482:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1786034580.019492:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1786034580.019497:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636169088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034580.019516:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636169088:12345-0@lo:400:kworker.0 Request processed in 19us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034580.019521:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1786034580.019558:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636169088:0@lo:400:kworker.0 00000100:00100000:3.0:1786034580.019567:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636169472:0@lo:400:kworker.0 00000100:00100000:3.0:1786034580.019590:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636169216:0@lo:400:kworker.0 00000100:00100000:3.0:1786034580.019599:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636169344:0@lo:400:kworker.0 00000100:00100000:0.0:1786034580.019756:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636168960 00000100:00100000:0.0:1786034580.019774:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636168960 00000100:00100000:0.0:1786034580.019812:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1786034580.019819:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636168960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034580.019973:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636168960:12345-0@lo:400:kworker.0 Request processed in 154us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034580.019980:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:2.0:1786034580.019991:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034580.020316:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636168960:0@lo:400:kworker.0 00000100:00100000:1.0:1786034580.067951:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034580.068032:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608867712 00000100:00100000:3.0:1786034580.068053:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608867712 00000100:00100000:3.0:1786034580.068114:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 48 00000100:00100000:3.0:1786034580.068123:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:10336:x1872792608867712:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034580.068144:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034580.068162:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758689 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.068249:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.068264:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.068275:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.068289:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.068296:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.068302:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.068412:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3ffa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.068421:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3ffa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.068428:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3ffa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034580.068444:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1786034580.068536:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.068544:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.068550:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.068556:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034580.070541:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.070563:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.070578:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:3.0:1786034580.070581:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034580.070586:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.070592:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af3ff9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.070609:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.070615:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.070635:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.070640:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034580.070643:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.070649:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.070656:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96454a119e00) 00010000:00010000:3.0:1786034580.070658:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034580.070661:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.070666:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.070714:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ff93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758689 expref: 34 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.070727:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3ffa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758689 expref: 33 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.070734:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034580.070736:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034580.070856:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0e00, rc 0) 00000100:00100000:3.0:1786034580.071011:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:10336:x1872792608867712:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 2888us (3067us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1786034580.071029:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 48 00000100:00100000:2.0:1786034580.091454:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034580.100615:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608867840 00000100:00100000:3.0:1786034580.100630:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608867840 00000100:00100000:3.0:1786034580.100703:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 49 00000100:00100000:3.0:1786034580.100714:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:10336:x1872792608867840:12345-192.168.203.56@tcp:54:lfs.0 00010000:00010000:3.0:1786034580.100783:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ffb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.100800:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ffb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.100811:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ffb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.100874:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ffb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.100881:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ffb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.100888:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ffb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.100894:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034580.100898:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ffb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.100905:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ffb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.100915:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034580.100930:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786034580.100936:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ffb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.100942:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ffb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034580.101018:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:10336:x1872792608867840:12345-192.168.203.56@tcp:54:lfs.0 Request processed in 306us (9572us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034580.101025:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 49 00000100:00100000:2.0:1786034580.106069:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034580.106136:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608868096 00000100:00100000:1.0:1786034580.106145:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608868096 00000100:00100000:1.0:1786034580.106204:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00100000:1.0:1786034580.106214:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:10336:x1872792608868096:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:1.0:1786034580.106434:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+34:10336:x1872792608868096:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 220us (372us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1786034580.106441:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 11 00010000:00010000:1.0:1786034580.143962:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786034580.336483:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1786034580.607771:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034580.614373:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608868352 00000100:00100000:3.0:1786034580.614389:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608868352 00000100:00100000:3.0:1786034580.614451:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 50 00000100:00100000:3.0:1786034580.614462:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+34:10367:x1872792608868352:12345-192.168.203.56@tcp:101:cat.0 00010000:00010000:3.0:1786034580.614485:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034580.614504:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ffbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758690 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.614619:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.614634:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.614645:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034580.614656:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1786034580.614915:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af3ffbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758690 expref: 37 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.614946:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758690 expref: 36 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.614955:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034580.614958:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034580.614961:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0000, rc 0) 00000100:00100000:3.0:1786034580.615019:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+36:10367:x1872792608868352:12345-192.168.203.56@tcp:101:cat.0 Request processed in 559us (7257us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1786034580.615026:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 50 00000100:00100000:3.0:1786034580.620724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034580.620770:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034580.620856:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608868608 00000100:00100000:1.0:1786034580.620864:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608868608 00000100:00100000:1.0:1786034580.620913:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:1.0:1786034580.620924:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+36:10367:x1872792608868608:12345-192.168.203.56@tcp:35:cat.0 00000100:00100000:1.0:1786034580.621190:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:10367:x1872792608868608:12345-192.168.203.56@tcp:35:cat.0 Request processed in 267us (474us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1786034580.621198:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:0.0:1786034580.621409:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608868736 00000100:00100000:0.0:1786034580.621414:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608868736 00000100:00100000:0.0:1786034580.621455:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 3 00000100:00100000:0.0:1786034580.621463:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a062050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:2362:x1872792608868736:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034580.621473:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034580.621496:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af3ffc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758690 expref: 37 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.621512:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:0.0:1786034580.621516:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034580.621551:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a062050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+36:2362:x1872792608868736:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 90us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034580.621568:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 3 00000001:00080000:0.0:1786034580.634345:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967325 is committed 00000004:00080000:0.0:1786034580.634360:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1786034580.634386:0:5883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9645595b6000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1786034580.634391:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9645747e4000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9645595b6b40 00000020:00080000:0.0:1786034580.634394:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9645747e4200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff964574789000 00000001:00080000:0.0:1786034580.634415:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000020:00080000:1.0:1786034580.634494:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1786034580.634608:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1786034580.634855:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636169600:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786034580.634920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034580.635070:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636169600 00000100:00100000:2.0:1786034580.635077:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636169600 00000100:00100000:2.0:1786034580.635127:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786034580.635137:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1872792636169600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786034580.635160:0:6719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1786034580.635191:0:6719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a74b992, atime: 0x6a74b992, ctime: 0x6a74b992, blocks: 0x1 00010000:00010000:2.0:1786034580.635199:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d98e25d6/0x490975051af3ffd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034580.635225:0:6719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=416s v=(0 0) 00010000:00010000:2.0:1786034580.635230:0:6719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034580.635236:0:6719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d98e25d6/0x490975051af3ffd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034580.635270:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d98e25d6/0x490975051af3ffd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034580.635280:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d98e25d6/0x490975051af3ffd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034580.635288:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d98e25d6/0x490975051af3ffd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034580.635305:0:6719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786034580.635910:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1872792636169600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 774us (988us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1786034580.635918:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1786034580.635954:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff964574d16d80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1786034580.635959:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636169600:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1786034580.639677:0:7670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034580.639690:0:7670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d98e25d6/0x490975051af3ffd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.639704:0:7670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7600 already unused, calling callback (ffffffffc1761020) 00010000:00010000:3.0:1786034580.639709:0:7670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d98e25d6/0x490975051af3ffd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.639720:0:7670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d98e25d6/0x490975051af3ffd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.640671:0:7670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d98e25d6/0x490975051af3ffd2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.640703:0:7670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d98e25d6/0x490975051af3ffd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034580.640726:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034580.640728:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034580.640730:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034580.706004:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034580.706158:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608868992 00000100:00100000:0.0:1786034580.706181:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608868992 00000100:00100000:0.0:1786034580.706241:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 51 00000100:00100000:0.0:1786034580.706251:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:10373:x1872792608868992:12345-192.168.203.56@tcp:101:dd.0 00010000:00010000:0.0:1786034580.706274:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034580.706278:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786034580.706303:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af3ff2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758666 expref: 14 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.706322:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:0.0:1786034580.706326:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786034580.706339:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af3ffd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758697 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.706433:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.706447:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3ffa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758689 expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.706455:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.706486:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3ffa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758689 expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.706498:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3ffa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758689 expref: 14 pid: 5862 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034580.706512:0:5863:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d69880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1872792636169728:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034580.706622:0:5863:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c751e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786034580.708891:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034580.708977:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608869120 00000100:00100000:1.0:1786034580.708986:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608869120 00010000:00010000:1.0:1786034580.709021:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3ffa8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758689 expref: 15 pid: 5862 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034580.709061:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 38 00000100:00100000:1.0:1786034580.709069:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:2363:x1872792608869120:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034580.709096:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034580.709104:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3ffa8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758689 expref: 15 pid: 5862 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034580.709118:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3ffa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758689 expref: 15 pid: 5862 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034580.709160:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:1.0:1786034580.709166:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034580.709175:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034580.709182:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034580.709201:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034580.709244:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:2363:x1872792608869120:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 176us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034580.709252:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 38 00010000:00010000:0.0:1786034580.709689:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af3ffa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758689 expref: 14 pid: 5862 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034580.709705:0:5863:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d69880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1872792636169728:192.168.203.56@tcp:104: 00010000:00010000:0.0:1786034580.709724:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.709734:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.709739:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034580.709756:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1786034580.709930:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af3ffd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758697 expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.709946:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758697 expref: 14 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.709954:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:0.0:1786034580.709957:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786034580.709959:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8200, rc 0) 00000100:00100000:0.0:1786034580.709991:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:10373:x1872792608868992:12345-192.168.203.56@tcp:101:dd.0 Request processed in 3741us (3996us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1786034580.709998:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 51 00000100:00100000:3.0:1786034580.718169:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034580.718246:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608869376 00000100:00100000:0.0:1786034580.718267:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608869376 00000100:00100000:0.0:1786034580.718317:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 52 00000100:00100000:0.0:1786034580.718326:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:10373:x1872792608869376:12345-192.168.203.56@tcp:36:dd.0 00010000:00010000:0.0:1786034580.718626:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3ffee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.718642:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3ffee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.718655:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3ffee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786034580.718706:0:6743:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1786034580.718732:0:6743:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000968a02f1 reply state 000000004d28387a transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3ffee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034580.718741:0:6743:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786034580.718859:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+17:10373:x1872792608869376:12345-192.168.203.56@tcp:36:dd.0 Request processed in 533us (697us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1786034580.718867:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 52 00000020:00080000:0.0:1786034580.718872:0:6743:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786034580.722097:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3ffee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.722113:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3ffee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.722121:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3ffee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.722127:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034580.722132:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3ffee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.722153:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3ffee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.722169:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:0.0:1786034580.722171:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034580.722175:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3ffee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034580.722181:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af3ffee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034581.044123:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034581.044709:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608869504 00000100:00100000:2.0:1786034581.044743:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608869504 00000100:00100000:2.0:1786034581.044816:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 53 00000100:00100000:2.0:1786034581.044849:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:10387:x1872792608869504:12345-192.168.203.56@tcp:101:stat.0 00010000:00010000:2.0:1786034581.044872:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034581.044890:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af3fff5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75869e expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.044947:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fffc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.044977:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.044989:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.045003:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40003 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.045010:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.045017:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.045335:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4000a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.045347:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758697 expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.045356:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4000a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.045386:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758697 expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.045400:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758697 expref: 17 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034581.045425:0:5861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d17100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636169856:192.168.203.56@tcp:104: 00000100:00100000:2.0:1786034581.045526:0:5861:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d58900 going to sleep for 11 seconds 00000100:00080000:3.0:1786034581.046367:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034581.054743:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034581.054865:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608869760 00000100:00100000:0.0:1786034581.054883:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608869760 00000100:00100000:0.0:1786034581.054960:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 13 00000100:00100000:2.0:1786034581.054967:0:5861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d17100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636169856:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034581.054979:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:5609:x1872792608869760:12345-192.168.203.56@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1786034581.055005:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4000a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034581.055320:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:5609:x1872792608869760:12345-192.168.203.56@tcp:35:ldlm_bl.0 Request processed in 346us (598us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1786034581.055329:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 13 00000100:00100000:2.0:1786034581.057558:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034581.057656:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608869888 00000100:00100000:0.0:1786034581.057666:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608869888 00010000:00010000:0.0:1786034581.057706:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758697 expref: 19 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034581.057859:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 39 00000100:00100000:0.0:1786034581.057870:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:2363:x1872792608869888:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034581.057889:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034581.057913:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758697 expref: 19 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.057926:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758697 expref: 19 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.057953:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af3ffe0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758697 expref: 19 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.057970:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:0.0:1786034581.057975:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4000a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.057986:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4000a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.057994:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4000a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.058025:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034581.058126:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:2363:x1872792608869888:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 258us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034581.058134:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 39 00010000:00010000:2.0:1786034581.058853:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4000a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.058862:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4000a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034581.058916:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1786034581.058920:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786034581.058963:0:5861:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4000a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.058978:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4000a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.058989:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.058997:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fffc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059004:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fffc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059023:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034581.059028:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fffc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059037:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fffc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059048:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:2.0:1786034581.059051:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034581.059056:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fffc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059062:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af3fffc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059076:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059082:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40003 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059089:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059094:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034581.059097:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059103:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40003 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059122:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96455a530600) 00010000:00010000:2.0:1786034581.059125:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034581.059128:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40003 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059134:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40003 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059175:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af3fff5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75869e expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059189:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4000a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75869e expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.059196:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:2.0:1786034581.059198:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786034581.059201:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7000, rc 0) 00000100:00100000:2.0:1786034581.059244:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+17:10387:x1872792608869504:12345-192.168.203.56@tcp:101:stat.0 Request processed in 14400us (15144us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034581.059252:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 53 00000100:00100000:3.0:1786034581.162354:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034581.162528:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608870144 00000100:00100000:0.0:1786034581.162541:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608870144 00000100:00100000:0.0:1786034581.162618:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 54 00000100:00100000:0.0:1786034581.162630:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+17:10393:x1872792608870144:12345-192.168.203.56@tcp:36:truncate.0 00010000:00010000:0.0:1786034581.162705:0:6743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034581.162913:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4000a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75869e expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.163017:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:0.0:1786034581.163024:0:6743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786034581.163284:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40011 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.163300:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.163311:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786034581.163365:0:6743:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1786034581.163390:0:6743:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000f650aab1 reply state 0000000000bf50a0 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034581.163399:0:6743:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786034581.163928:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:10393:x1872792608870144:12345-192.168.203.56@tcp:36:truncate.0 Request processed in 1297us (1584us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1786034581.163937:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 54 00000020:00080000:0.0:1786034581.163944:0:6743:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786034581.171170:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034581.174879:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.174900:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40011 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.174910:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40011 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.174917:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034581.174944:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40011 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.175407:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40011 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.175431:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:0.0:1786034581.175434:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034581.175439:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40011 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.175446:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40011 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034581.415072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034581.415306:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608870272 00000100:00100000:1.0:1786034581.415315:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608870272 00000100:00100000:1.0:1786034581.415373:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 55 00000100:00100000:1.0:1786034581.415383:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:10407:x1872792608870272:12345-192.168.203.56@tcp:101:stat.0 00010000:00010000:1.0:1786034581.415407:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034581.415427:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7586a5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.415501:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af4001f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.415524:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af4001f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.415536:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af4001f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.415549:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.415556:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.415563:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.415911:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4002d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.415920:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4002d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.415927:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4002d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034581.415959:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1786034581.415964:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786034581.415995:0:5863:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4002d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416017:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4002d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416025:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af4001f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416032:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af4001f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416038:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af4001f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416044:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034581.416047:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af4001f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416054:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af4001f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416065:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:1.0:1786034581.416068:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034581.416071:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af4001f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416076:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af4001f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416087:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416092:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40026 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416105:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416110:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034581.416113:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416119:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40026 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416126:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9645521d1e00) 00010000:00010000:1.0:1786034581.416129:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034581.416131:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40026 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416136:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416262:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586a5 expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416279:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4002d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586a5 expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.416286:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:1.0:1786034581.416288:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034581.416291:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00800, rc 0) 00000100:00100000:1.0:1786034581.416350:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:10407:x1872792608870272:12345-192.168.203.56@tcp:101:stat.0 Request processed in 968us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034581.416371:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 55 00000100:00100000:1.0:1786034581.543443:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034581.543569:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608870528 00000100:00100000:3.0:1786034581.543578:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608870528 00000100:00100000:3.0:1786034581.543629:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 56 00000100:00100000:3.0:1786034581.543639:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:10417:x1872792608870528:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034581.543656:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034581.543677:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40034 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7586ac expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034581.543963:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1786034581.544137:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40034 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586ac expref: 21 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.544152:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119600) 00010000:00010000:3.0:1786034581.544161:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786034581.544167:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586ac expref: 21 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.544276:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0200, rc 0) 00000100:00100000:3.0:1786034581.544336:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:10417:x1872792608870528:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 698us (902us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1786034581.544344:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 56 00000100:00100000:2.0:1786034581.550454:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034581.550859:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608870784 00000100:00100000:3.0:1786034581.550868:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608870784 00000100:00100000:3.0:1786034581.550910:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:3.0:1786034581.550919:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:10417:x1872792608870784:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:3.0:1786034581.551356:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:10417:x1872792608870784:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 437us (910us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1786034581.551364:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:0.0:1786034581.639746:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034581.639898:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608871040 00000100:00100000:2.0:1786034581.639914:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608871040 00000100:00100000:2.0:1786034581.639998:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 57 00000100:00100000:2.0:1786034581.640009:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:10423:x1872792608871040:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:2.0:1786034581.640033:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034581.640055:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af40042 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7586b3 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.640168:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.640195:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4002d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586a5 expref: 22 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.640204:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.640252:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4002d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586a5 expref: 22 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.640266:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4002d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586a5 expref: 22 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034581.640280:0:5861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d15180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636169984:192.168.203.56@tcp:104: 00000100:00100000:2.0:1786034581.640381:0:5861:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d58240 going to sleep for 11 seconds 00000100:00100000:2.0:1786034581.648484:0:5861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d15180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636169984:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034581.648532:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034581.654095:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034581.654350:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608871168 00000100:00100000:1.0:1786034581.654362:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608871168 00010000:00010000:1.0:1786034581.654416:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4002d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586a5 expref: 23 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034581.654469:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 40 00000100:00100000:1.0:1786034581.654480:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+23:2362:x1872792608871168:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034581.654499:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034581.654506:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4002d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586a5 expref: 23 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.654531:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4002d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586a5 expref: 23 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.654558:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4002d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586a5 expref: 23 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.654576:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:1.0:1786034581.654582:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.654602:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.654611:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.654661:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034581.654737:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+22:2362:x1872792608871168:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 253us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034581.654746:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 40 00010000:00010000:3.0:1786034581.654979:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.654989:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034581.655010:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1786034581.655191:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af40042 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586b3 expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.655207:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586b3 expref: 22 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.655226:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034581.655229:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786034581.655231:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7200, rc 0) 00000100:00100000:3.0:1786034581.655259:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+22:10423:x1872792608871040:12345-192.168.203.56@tcp:101:bash.0 Request processed in 15253us (15532us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1786034581.655267:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 57 00000100:00100000:1.0:1786034581.660170:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034581.660328:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608871424 00000100:00100000:0.0:1786034581.660340:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608871424 00000100:00100000:0.0:1786034581.660401:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 58 00000100:00100000:0.0:1786034581.660412:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+22:10423:x1872792608871424:12345-192.168.203.56@tcp:36:bash.0 00010000:00010000:1.0:1786034581.661065:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40057 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.661084:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.661097:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786034581.661159:0:6743:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1786034581.661188:0:6743:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000099b9c4c9 reply state 0000000078eef846 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034581.661198:0:6743:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786034581.661301:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+25:10423:x1872792608871424:12345-192.168.203.56@tcp:36:bash.0 Request processed in 890us (1144us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1786034581.661308:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 58 00000020:00080000:1.0:1786034581.661313:0:6743:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786034581.663847:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.663864:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40057 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.663872:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40057 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.663898:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034581.663903:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40057 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.663912:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40057 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.663931:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:1.0:1786034581.663935:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034581.663940:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40057 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.663955:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40057 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034581.672932:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034581.673203:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608871552 00000100:00100000:0.0:1786034581.673216:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608871552 00000100:00100000:0.0:1786034581.673291:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 59 00000100:00100000:0.0:1786034581.673303:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:10423:x1872792608871552:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:0.0:1786034581.673334:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034581.673361:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4005e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7586ba expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.673463:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.673494:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586b3 expref: 25 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.673504:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40065 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.673554:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586b3 expref: 25 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034581.673569:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586b3 expref: 25 pid: 5861 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034581.674667:0:5863:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1872792636170112:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034581.674876:0:5863:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645620a86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034581.690710:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034581.691071:0:5863:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1872792636170112:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034581.691106:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034581.695088:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608871680 00000100:00100000:2.0:1786034581.695104:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608871680 00010000:00010000:2.0:1786034581.695166:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586b3 expref: 26 pid: 5861 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034581.695287:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 41 00000100:00100000:2.0:1786034581.695314:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:2362:x1872792608871680:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034581.695334:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034581.695342:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586b3 expref: 26 pid: 5861 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.695356:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586b3 expref: 26 pid: 5861 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.695382:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af40049 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586b3 expref: 26 pid: 5861 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.695399:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:2.0:1786034581.695404:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.695416:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.695423:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40065 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034581.695467:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034581.695548:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+25:2362:x1872792608871680:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 236us (4850us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034581.695555:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 41 00010000:00010000:3.0:1786034581.695629:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.695639:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034581.695692:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1786034581.695697:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786034581.695728:0:5863:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.695763:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4005e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586ba expref: 25 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.695779:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40065 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586ba expref: 24 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.695787:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034581.695789:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034581.695792:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9a00, rc 0) 00000100:00100000:3.0:1786034581.695818:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:10423:x1872792608871552:12345-192.168.203.56@tcp:101:bash.0 Request processed in 22519us (22901us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034581.695866:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 59 00000100:00100000:0.0:1786034581.702357:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034581.702522:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608871936 00000100:00100000:3.0:1786034581.702534:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608871936 00000100:00100000:3.0:1786034581.702598:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00100000:3.0:1786034581.702608:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542eecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:10423:x1872792608871936:12345-192.168.203.56@tcp:35:bash.0 00000100:00100000:3.0:1786034581.702899:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542eecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+25:10423:x1872792608871936:12345-192.168.203.56@tcp:35:bash.0 Request processed in 292us (553us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1786034581.702907:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00100000:0.0:1786034581.797880:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034581.798047:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608872192 00000100:00100000:3.0:1786034581.798059:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608872192 00000100:00100000:3.0:1786034581.798127:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 60 00000100:00100000:3.0:1786034581.798139:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+25:10433:x1872792608872192:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034581.798169:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034581.798195:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4006c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7586c1 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034581.798530:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1786034581.798724:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4006c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586c1 expref: 27 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.798754:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119600) 00010000:00010000:3.0:1786034581.798758:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786034581.798764:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4006c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586c1 expref: 27 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.798784:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0200, rc 0) 00000100:00100000:3.0:1786034581.798910:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:10433:x1872792608872192:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 773us (1041us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1786034581.798917:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 60 00000100:00100000:0.0:1786034581.806943:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034581.811092:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608872320 00000100:00100000:3.0:1786034581.811108:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608872320 00000100:00100000:3.0:1786034581.811189:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 61 00000100:00100000:3.0:1786034581.811200:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:10433:x1872792608872320:12345-192.168.203.56@tcp:34:lfs.0 00010000:00010000:3.0:1786034581.811301:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4007a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.811321:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4007a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.811336:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4007a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.811352:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40081 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.811360:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.811367:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813309:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813328:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813339:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786034581.813407:0:5861:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813421:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4007a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813428:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4007a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813435:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4007a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813442:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034581.813447:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4007a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813454:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4007a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813469:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:3.0:1786034581.813472:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034581.813477:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4007a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813484:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4007a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813498:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813505:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40081 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813530:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813536:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034581.813538:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813545:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40081 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813554:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96454a119c00) 00010000:00010000:3.0:1786034581.813556:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034581.813559:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40081 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813565:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40081 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813581:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813588:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40088 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813593:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813598:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034581.813601:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813618:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40088 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813627:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034581.813629:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034581.813632:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40088 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.813637:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40088 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034581.814877:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:10433:x1872792608872320:12345-192.168.203.56@tcp:34:lfs.0 Request processed in 2730us (7007us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034581.814893:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 61 00000100:00100000:0.0:1786034581.834041:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034581.834170:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608872576 00000100:00100000:3.0:1786034581.834181:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608872576 00000100:00100000:3.0:1786034581.834244:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:3.0:1786034581.834255:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:10433:x1872792608872576:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:3.0:1786034581.834808:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:10433:x1872792608872576:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 553us (778us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1786034581.834817:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:0.0:1786034581.891133:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034581.891217:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608872832 00000100:00100000:3.0:1786034581.891230:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608872832 00000100:00100000:3.0:1786034581.891301:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 62 00000100:00100000:3.0:1786034581.891312:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:10436:x1872792608872832:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034581.891341:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034581.891367:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4008f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7586c8 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.891476:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40096 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.891492:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40096 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.891504:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40096 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.891568:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4009d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.891576:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4009d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.891583:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4009d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892111:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af400a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892122:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af400a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892130:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af400a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034581.892141:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1786034581.892863:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40096 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892872:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40096 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892889:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40096 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892896:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034581.892901:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40096 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892910:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40096 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892923:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:3.0:1786034581.892927:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034581.892932:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40096 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892938:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40096 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892953:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4009d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892959:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4009d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892965:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4009d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892971:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034581.892974:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4009d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892990:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4009d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.892999:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96454a119c00) 00010000:00010000:3.0:1786034581.893001:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034581.893004:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4009d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.893010:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4009d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.893930:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4008f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586c8 expref: 30 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.893948:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af400a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586c8 expref: 29 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.893956:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034581.893958:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034581.893961:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0000, rc 0) 00000100:00100000:3.0:1786034581.894046:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:10436:x1872792608872832:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 2734us (2923us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1786034581.894054:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 62 00000100:00100000:1.0:1786034581.899876:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034581.900002:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608872960 00000100:00100000:3.0:1786034581.900013:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608872960 00000100:00100000:3.0:1786034581.900080:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 63 00000100:00100000:3.0:1786034581.900091:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:10436:x1872792608872960:12345-192.168.203.56@tcp:54:lfs.0 00010000:00010000:3.0:1786034581.900198:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.900233:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.900245:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.900279:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.900287:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.900294:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.900302:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034581.900307:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.900314:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.900327:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034581.900330:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786034581.900335:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034581.900343:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034581.900626:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:10436:x1872792608872960:12345-192.168.203.56@tcp:54:lfs.0 Request processed in 535us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034581.900634:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 63 00000100:00100000:0.0:1786034581.910863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034581.911029:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608873088 00000100:00100000:1.0:1786034581.911042:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608873088 00000100:00100000:1.0:1786034581.911121:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 4 00000100:00100000:1.0:1786034581.911134:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:2363:x1872792608873088:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034581.911153:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034581.911182:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af400a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586c8 expref: 29 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034581.911223:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:1.0:1786034581.911229:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034581.911298:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+28:2363:x1872792608873088:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 166us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034581.911307:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 4 00000100:00100000:1.0:1786034581.915550:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034581.915638:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608873344 00000100:00100000:3.0:1786034581.915650:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608873344 00000100:00100000:3.0:1786034581.915717:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 17 00000100:00100000:3.0:1786034581.915729:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+28:10436:x1872792608873344:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:3.0:1786034581.916064:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:10436:x1872792608873344:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 336us (528us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1786034581.916072:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 17 00000100:00100000:0.0:1786034582.162655:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034582.162747:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608873600 00000100:00100000:1.0:1786034582.162759:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608873600 00000100:00100000:1.0:1786034582.162854:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 64 00000100:00100000:1.0:1786034582.162867:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:10454:x1872792608873600:12345-192.168.203.56@tcp:101:cat.0 00010000:00010000:1.0:1786034582.162899:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034582.162924:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af400b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7586cf expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034582.163187:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af400c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034582.163260:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af400c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034582.163276:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af400c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034582.163289:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1786034582.163442:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af400b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586cf expref: 32 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034582.163487:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af400c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586cf expref: 31 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034582.163496:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:1.0:1786034582.163499:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1786034582.163502:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01c00, rc 0) 00000100:00100000:1.0:1786034582.163584:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:10454:x1872792608873600:12345-192.168.203.56@tcp:101:cat.0 Request processed in 720us (942us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1786034582.163591:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 64 00010000:00010000:1.0:1786034582.192055:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034582.202494:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034582.202703:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608873728 00000100:00100000:0.0:1786034582.202716:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608873728 00000100:00100000:0.0:1786034582.202862:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 65 00000100:00100000:0.0:1786034582.202874:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:10455:x1872792608873728:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034582.202901:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034582.202943:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af400ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7586d6 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.203024:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af400d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.203040:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af400d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.203052:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af400d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034582.203438:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1786034582.203442:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034582.203527:0:5861:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af400d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.203557:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af400ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586d6 expref: 33 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.203574:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af400d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586d6 expref: 32 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.203583:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:0.0:1786034582.203586:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034582.203590:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9c00, rc 0) 00000100:00100000:0.0:1786034582.203662:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:10455:x1872792608873728:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 791us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034582.203671:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 65 00000100:00100000:0.0:1786034582.216795:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.217049:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608874112 00000100:00100000:3.0:1786034582.217061:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608874112 00000100:00100000:3.0:1786034582.217137:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 18 00000100:00100000:3.0:1786034582.217148:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:10455:x1872792608874112:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:3.0:1786034582.217561:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:10455:x1872792608874112:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 413us (777us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1786034582.217569:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 18 00000100:00100000:1.0:1786034582.226760:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034582.226871:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608874240 00000100:00100000:0.0:1786034582.226884:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608874240 00000100:00100000:0.0:1786034582.226963:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 5 00000100:00100000:0.0:1786034582.226974:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:10455:x1872792608874240:12345-192.168.203.56@tcp:103:lfs.0 00010000:00010000:0.0:1786034582.226995:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1786034582.227028:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40065 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586ba expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.227055:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af400c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586cf expref: 32 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.227068:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af3ff69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75867b expref: 31 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.227091:0:7671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119500) 00010000:00010000:0.0:1786034582.227103:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034582.227170:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+30:10455:x1872792608874240:12345-192.168.203.56@tcp:103:lfs.0 Request processed in 198us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034582.227178:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 5 00000100:00100000:1.0:1786034582.229721:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.229920:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608874368 00000100:00100000:3.0:1786034582.229933:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608874368 00000100:00100000:3.0:1786034582.229997:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 66 00000100:00100000:3.0:1786034582.230008:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+30:10455:x1872792608874368:12345-192.168.203.56@tcp:58:lfs.0 00010000:00010000:3.0:1786034582.230150:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.230170:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.230210:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786034582.230977:0:6743:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786034582.231195:0:6743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1786034582.231266:0:6743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1786034582.231396:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+30:10455:x1872792608874368:12345-192.168.203.56@tcp:58:lfs.0 Request processed in 1387us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034582.231406:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 66 00000100:00100000:1.0:1786034582.262267:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034582.262426:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608874496 00000100:00100000:0.0:1786034582.262440:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608874496 00000100:00100000:0.0:1786034582.262522:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 67 00000100:00100000:0.0:1786034582.262534:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+30:10457:x1872792608874496:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034582.262562:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034582.262588:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af400e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7586dd expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.262696:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af400ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.262713:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af400ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.262737:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af400ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.262754:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.262762:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.262769:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264291:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af400f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264308:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af400f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264318:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af400f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034582.264366:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1786034582.264372:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034582.264395:0:5861:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af400f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264420:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af400f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264430:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af400ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264436:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af400ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264443:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af400ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264449:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034582.264453:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af400ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264461:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af400ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264473:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:0.0:1786034582.264476:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034582.264481:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af400ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264488:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af400ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264502:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264519:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264533:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264539:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034582.264542:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264549:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264557:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff964547ee4b00) 00010000:00010000:0.0:1786034582.264560:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034582.264563:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264569:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264610:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af400e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586dd expref: 32 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264626:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af400f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586dd expref: 31 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.264634:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119c00) 00010000:00010000:0.0:1786034582.264636:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034582.264639:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8400, rc 0) 00000100:00100000:0.0:1786034582.264724:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:10457:x1872792608874496:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 2190us (2468us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034582.264742:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 67 00000100:00100000:0.0:1786034582.365474:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034582.365536:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034582.365572:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.365659:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608874752 00000100:00100000:3.0:1786034582.365671:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608874752 00000100:00100000:3.0:1786034582.365750:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 76 00000100:00100000:3.0:1786034582.365762:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2362:x1872792608874752:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034582.365885:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2362:x1872792608874752:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 125us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034582.365892:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 76 00000100:00100000:1.0:1786034582.365974:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608874880 00000100:00100000:1.0:1786034582.365979:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608874880 00000100:00100000:1.0:1786034582.366019:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 177 00000100:00100000:1.0:1786034582.366027:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2362:x1872792608874880:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034582.366058:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2362:x1872792608874880:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 33us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034582.366064:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 177 00000100:00100000:2.0:1786034582.366337:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608874624 00000100:00100000:2.0:1786034582.366342:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608874624 00000100:00100000:2.0:1786034582.366383:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 306 00000100:00100000:2.0:1786034582.366392:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608874624:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034582.366454:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608874624:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 63us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034582.366461:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 306 00000100:00080000:0.0:1786034582.366622:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786034582.366628:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1786034582.384187:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786034582.384257:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786034582.384333:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1786034582.384341:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786034582.384528:0:11732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e073800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11732:1872792636170240:192.168.203.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786034582.384720:0:11732:0:(client.c:2702:ptlrpc_set_wait()) set ffff964552589840 going to sleep for 11 seconds 00000100:00100000:2.0:1786034582.401031:0:11732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e073800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11732:1872792636170240:192.168.203.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786034582.402057:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034582.402338:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608875008 00000100:00100000:0.0:1786034582.402345:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608875008 00000100:00100000:0.0:1786034582.402398:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 1 00000100:00100000:0.0:1786034582.402407:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:10468:x1872792608875008:12345-192.168.203.56@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1786034582.402479:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:10468:x1872792608875008:12345-192.168.203.56@tcp:900:lhsmtool_posix.0 Request processed in 73us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034582.402486:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 1 00000100:00100000:1.0:1786034582.407594:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.407983:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608875136 00000100:00100000:3.0:1786034582.407993:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608875136 00000100:00100000:3.0:1786034582.408049:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 68 00000100:00100000:3.0:1786034582.408059:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:10468:x1872792608875136:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786034582.408089:0:5863:0:(mdt_handler.c:8007:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786034582.408191:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:10468:x1872792608875136:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 Request processed in 133us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034582.408199:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 68 00000100:00100000:1.0:1786034582.410949:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034582.411029:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608875264 00000100:00100000:0.0:1786034582.411038:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608875264 00000100:00100000:0.0:1786034582.411087:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 69 00000100:00100000:0.0:1786034582.411095:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:10468:x1872792608875264:12345-192.168.203.56@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786034582.411161:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400ff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411188:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411198:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411253:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40106 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411267:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40106 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411274:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40106 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411297:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4010d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411306:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4010d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411312:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4010d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034582.411343:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1786034582.411347:0:6743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034582.411361:0:6743:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4010d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411372:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411378:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400ff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411384:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411390:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034582.411394:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411417:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400ff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411429:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9645521d1700) 00010000:00010000:0.0:1786034582.411432:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034582.411437:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411442:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af400ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411451:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40106 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411457:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40106 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411463:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40106 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411468:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034582.411471:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40106 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411477:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40106 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411483:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff964547ee4b00) 00010000:00010000:0.0:1786034582.411485:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034582.411487:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40106 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411500:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40106 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411524:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4010d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411530:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4010d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411535:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4010d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411540:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034582.411543:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4010d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411548:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4010d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411556:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119c00) 00010000:00010000:0.0:1786034582.411558:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034582.411561:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4010d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.411567:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4010d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034582.411625:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:10468:x1872792608875264:12345-192.168.203.56@tcp:34:lhsmtool_posix.0 Request processed in 530us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034582.411632:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 69 00000100:00100000:1.0:1786034582.420198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.420407:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608875520 00000100:00100000:3.0:1786034582.420417:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608875520 00000100:00100000:3.0:1786034582.420481:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 70 00000100:00100000:3.0:1786034582.420491:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:10468:x1872792608875520:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786034582.420519:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034582.420540:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af40114 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7586e4 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.420635:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4011b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.420650:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4011b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.420661:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4011b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034582.420688:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1786034582.420778:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4011b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.420785:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4011b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.420792:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4011b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.420798:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034582.420802:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4011b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.420810:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4011b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.420862:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119c00) 00010000:00010000:3.0:1786034582.420864:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786034582.420869:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4011b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.420875:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4011b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.420913:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af40114 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586e4 expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.420923:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9645521d1700) 00010000:00010000:3.0:1786034582.420925:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786034582.420929:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af40114 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586e4 expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.420937:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312200, rc 0) 00000100:00100000:3.0:1786034582.420982:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:10468:x1872792608875520:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 494us (794us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1786034582.420990:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 70 00000100:00100000:0.0:1786034582.426240:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034582.426335:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608875648 00000100:00100000:1.0:1786034582.426344:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608875648 00000100:00100000:1.0:1786034582.426406:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 71 00000100:00100000:1.0:1786034582.426415:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:10468:x1872792608875648:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786034582.426449:0:6743:0:(mdt_handler.c:8007:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786034582.426567:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:10468:x1872792608875648:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 Request processed in 153us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034582.426575:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 71 00000100:00100000:1.0:1786034582.430292:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.430412:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608875904 00000100:00100000:3.0:1786034582.430421:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608875904 00000100:00100000:3.0:1786034582.430470:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 72 00000100:00100000:3.0:1786034582.430479:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:10468:x1872792608875904:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786034582.430499:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034582.430502:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786034582.430540:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af400d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586d6 expref: 32 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.430567:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:3.0:1786034582.430572:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034582.430584:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af40129 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7586eb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786034582.433210:0:5863:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1786034582.433481:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40130 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.433497:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.433516:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.433573:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af40129 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586eb expref: 34 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.433590:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586eb expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.433598:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96454a119e00) 00010000:00010000:3.0:1786034582.433600:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034582.433603:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f1c00, rc 0) 00000100:00100000:3.0:1786034582.433677:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:10468:x1872792608875904:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 3198us (3392us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1786034582.438052:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 72 00000100:00100000:0.0:1786034582.442153:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.442279:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608876160 00000100:00100000:3.0:1786034582.442288:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608876160 00000100:00100000:3.0:1786034582.442346:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 73 00000100:00100000:3.0:1786034582.442356:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:10468:x1872792608876160:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786034582.442436:0:6743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034582.442463:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40130 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586eb expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.442482:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96454a119e00) 00010000:00010000:3.0:1786034582.442491:0:6743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034582.442521:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af4013e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.442534:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af4013e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.442543:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af4013e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.442557:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40145 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x672554ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.442563:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x672554ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.442569:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x672554ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.443005:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af4013e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.443021:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af4013e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.443028:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af4013e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.443034:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034582.443038:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af4013e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.443045:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af4013e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.443053:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:3.0:1786034582.443056:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034582.443059:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af4013e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.443064:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af4013e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.443073:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x672554ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.443078:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40145 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x672554ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.443083:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40145 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x672554ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.443088:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034582.443095:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40145 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x672554ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.443101:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40145 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x672554ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.443108:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x672554ae (ffff96454a119300) 00010000:00010000:3.0:1786034582.443110:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034582.443112:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40145 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x672554ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.443117:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40145 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x672554ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034582.443182:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:10468:x1872792608876160:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 827us (1037us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786034582.443189:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 73 00000100:00100000:0.0:1786034582.451915:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.451995:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608876288 00000100:00100000:3.0:1786034582.452004:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608876288 00000100:00100000:3.0:1786034582.452059:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 74 00000100:00100000:3.0:1786034582.452068:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:10468:x1872792608876288:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786034582.452087:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034582.452108:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4014c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7586f2 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.452140:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40153 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.452153:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.452178:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.452264:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4014c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f2 expref: 34 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.452281:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f2 expref: 33 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.452289:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96454a119000) 00010000:00010000:3.0:1786034582.452292:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786034582.452521:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0800, rc 0) 00000100:00100000:3.0:1786034582.452606:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:10468:x1872792608876288:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 539us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034582.452615:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 74 00000100:00100000:0.0:1786034582.466800:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.466951:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608876544 00000100:00100000:3.0:1786034582.466960:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608876544 00000100:00100000:3.0:1786034582.467014:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 75 00000100:00100000:3.0:1786034582.467023:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:10468:x1872792608876544:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786034582.467096:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4015a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.467112:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4015a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.467123:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4015a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786034582.467555:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1786034582.467565:0:5862:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418675741214ns, next at 419675738995ns, rc = 0 00000004:00010000:3.0:1786034582.467643:0:5862:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000cd8cf0b3 reply state 00000000949fd694 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4015a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034582.467652:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786034582.467785:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+35:10468:x1872792608876544:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 762us (993us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1786034582.467792:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 75 00010000:00010000:3.0:1786034582.470372:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4015a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.470438:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4015a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.470446:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4015a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.470452:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034582.470456:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4015a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.470464:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4015a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.470479:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96454a119000) 00010000:00010000:3.0:1786034582.470482:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786034582.470486:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4015a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.470502:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4015a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034582.475223:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034582.475528:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608876672 00000100:00100000:1.0:1786034582.475536:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608876672 00000100:00100000:1.0:1786034582.475585:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 76 00000100:00100000:1.0:1786034582.475594:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+34:10468:x1872792608876672:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786034582.475615:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034582.475634:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af40161 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7586f9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034582.475786:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af40161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f9 expref: 35 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034582.475802:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af40161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f9 expref: 35 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034582.475886:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96454a119000) 00010000:00010000:1.0:1786034582.475889:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786034582.475892:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00e00, rc 0) 00000100:00100000:1.0:1786034582.475970:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+35:10468:x1872792608876672:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 377us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034582.475977:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 76 00000100:00100000:2.0:1786034582.487734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.487796:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608876800 00000100:00100000:3.0:1786034582.487805:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608876800 00000100:00100000:3.0:1786034582.487872:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 25 00000100:00100000:3.0:1786034582.487881:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1872792608876800:12345-192.168.203.56@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1786034582.487913:0:6719:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:3.0:1786034582.487943:0:6719:0:(genops.c:1406:class_connect()) connect: client 696d4f9b-62ce-40a0-a754-08fa96a026cd, cookie 0x490975051af40168 00002000:00100000:3.0:1786034582.487955:0:6719:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 696d4f9b-62ce-40a0-a754-08fa96a026cd/ffff96454adf5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113834 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786034582.487977:0:6719:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786034582.488199:0:6719:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1786034582.488227:0:6719:0:(import.c:65:import_set_state_nolock()) ffff96454adf3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786034582.494572:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2361:x1872792608876800:12345-192.168.203.56@tcp:8:lhsmtool_posix.0 Request processed in 6678us (6843us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034582.494588:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 25 00000100:00100000:1.0:1786034582.501597:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034582.501679:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608876928 00000100:00100000:2.0:1786034582.501688:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608876928 00000100:00100000:2.0:1786034582.501752:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 26 00000100:00100000:2.0:1786034582.501762:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:0:x1872792608876928:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1786034582.504461:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1786034582.570198:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1786034582.570219:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 696d4f9b-62ce-40a0-a754-08fa96a026cd 00000100:00100000:2.0:1786034582.570477:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:0:x1872792608876928:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 Request processed in 68708us (68879us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1786034582.570490:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 26 00000100:00100000:0.0:1786034582.574342:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.574485:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608877184 00000100:00100000:3.0:1786034582.574517:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608877184 00000100:00100000:3.0:1786034582.574578:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 19 00000100:00100000:3.0:1786034582.574590:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+35:10468:x1872792608877184:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786034582.574892:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+36:10468:x1872792608877184:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 Request processed in 303us (561us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1786034582.574901:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 19 00000100:00100000:0.0:1786034582.580763:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.580955:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608877440 00000100:00100000:3.0:1786034582.580979:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608877440 00000100:00100000:3.0:1786034582.581294:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 77 00000100:00100000:3.0:1786034582.581308:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+36:10468:x1872792608877440:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786034582.581490:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+36:10468:x1872792608877440:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 185us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034582.593989:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 77 00000100:00100000:1.0:1786034582.603979:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.604245:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608877568 00000100:00100000:3.0:1786034582.604258:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608877568 00000100:00100000:3.0:1786034582.604325:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 78 00000100:00100000:3.0:1786034582.604473:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+36:10468:x1872792608877568:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786034582.604502:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034582.604536:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4016f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758700 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.604617:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40176 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.604631:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.604643:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034582.604682:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786034582.604701:0:5861:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.604740:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4016f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758700 expref: 38 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.604768:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40176 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758700 expref: 37 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.604776:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96454a119000) 00010000:00010000:3.0:1786034582.604779:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786034582.604782:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0200, rc 0) 00000100:00100000:3.0:1786034582.604859:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:10468:x1872792608877568:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 525us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034582.604865:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 78 00000100:00100000:3.0:1786034582.608784:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034582.608921:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608877696 00000100:00100000:2.0:1786034582.608933:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608877696 00000100:00100000:2.0:1786034582.609001:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 27 00000100:00100000:2.0:1786034582.609013:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2364:x1872792608877696:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786034582.609035:0:6720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034582.609064:0:6720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006079e502/0x490975051af4017d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758707 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786034582.609096:0:6720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a74b995, blocks: 0x1 00010000:00010000:2.0:1786034582.609131:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1786034582.609137:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034582.609148:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006079e502/0x490975051af4017d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758707 expref: 6 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034582.609190:0:6720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006079e502/0x490975051af4017d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758707 expref: 6 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034582.609207:0:6720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6400, rc 0) 00000100:00100000:2.0:1786034582.609278:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2364:x1872792608877696:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 266us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034582.609286:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 27 00000100:00100000:2.0:1786034582.620167:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034582.622963:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608877952 00000100:00100000:0.0:1786034582.622979:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608877952 00000100:00100000:2.0:1786034582.630674:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 79 00000100:00100000:2.0:1786034582.630689:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:10468:x1872792608877952:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786034582.630861:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:10468:x1872792608877952:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 174us (11047us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034582.630869:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 79 00000100:00100000:1.0:1786034582.642675:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.642808:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608878080 00000100:00100000:3.0:1786034582.642821:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608878080 00000100:00100000:3.0:1786034582.642914:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 28 00000100:00100000:3.0:1786034582.642924:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:10468:x1872792608878080:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786034582.642946:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034582.642969:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000767e893f/0x490975051af40184 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75870e expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.643007:0:8676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006079e502/0x490975051af4017d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758707 expref: 7 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.643016:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034582.643021:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034582.643027:0:8676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000767e893f/0x490975051af40184 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75870e expref: 7 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.643098:0:8676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006079e502/0x490975051af4017d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758707 expref: 7 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034582.643120:0:8676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006079e502/0x490975051af4017d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758707 expref: 7 pid: 6720 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034582.643137:0:8676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1872792636170368:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034582.643250:0:8676:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645620a86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034582.650724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034582.651139:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608878208 00000100:00100000:2.0:1786034582.651150:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608878208 00010000:00010000:2.0:1786034582.651206:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006079e502/0x490975051af4017d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758707 expref: 8 pid: 6720 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034582.651250:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 42 00000100:00100000:2.0:1786034582.651261:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454acef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2362:x1872792608878208:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034582.651278:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034582.651307:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006079e502/0x490975051af4017d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758707 expref: 8 pid: 6720 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034582.651343:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006079e502/0x490975051af4017d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758707 expref: 8 pid: 6720 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034582.651374:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034582.651379:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034582.651388:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000767e893f/0x490975051af40184 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75870e expref: 8 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034582.651399:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000767e893f/0x490975051af40184 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75870e expref: 8 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034582.651442:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000767e893f/0x490975051af40184 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75870e expref: 8 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034582.651457:0:5846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c82680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5846:1872792636170496:192.168.203.56@tcp:105: 00000100:00100000:2.0:1786034582.651547:0:5846:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d58f00 going to sleep for 11 seconds 00010000:00010000:0.0:1786034582.659688:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006079e502/0x490975051af4017d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758707 expref: 8 pid: 6720 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034582.659721:0:8676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1872792636170368:192.168.203.56@tcp:104: 00010000:00010000:0.0:1786034582.659762:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000767e893f/0x490975051af40184 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75870e expref: 7 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.659781:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0e00, rc 0) 00000100:00100000:0.0:1786034582.661843:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:10468:x1872792608878080:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 18900us (19162us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034582.661855:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 28 00000100:00100000:2.0:1786034582.667994:0:5846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c82680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5846:1872792636170496:192.168.203.56@tcp:105: 00010000:00010000:2.0:1786034582.668038:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034582.668134:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454acef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608878208:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 16873us (17421us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034582.668147:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 42 00000100:00100000:0.0:1786034582.675121:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034582.676256:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608878336 00000100:00100000:2.0:1786034582.676269:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608878336 00002000:00100000:2.0:1786034582.676329:0:6727:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff96457dbc5880 x1872792608878336/t0(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:553/0 lens 504/0 e 0 to 0 dl 1786034593 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786034582.676365:0:6727:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96457dbc5880 with x1872792608878336 ext(0->8) 00002000:00010000:2.0:1786034582.676371:0:6727:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96457dbc5880 00000100:00100000:2.0:1786034582.676406:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:2.0:1786034582.676416:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608878336:12345-192.168.203.56@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786034582.679697:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2362:x1872792608878336:12345-192.168.203.56@tcp:4:lhsmtool_posix.0 Request processed in 3274us (4582us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1786034582.679721:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 0 00002000:00100000:2.0:1786034582.680075:0:6727:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff96457dbc5880 x1872792608878336/t4294967302(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:553/0 lens 504/448 e 0 to 0 dl 1786034593 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786034582.680087:0:6727:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96457dbc5880 with x1872792608878336 ext(0->8) 00002000:00010000:2.0:1786034582.680093:0:6727:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96457dbc5880 00000100:00100000:1.0:1786034582.708530:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034582.713235:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608878464 00000100:00100000:3.0:1786034582.713252:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608878464 00000100:00100000:3.0:1786034582.713342:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 80 00000100:00100000:3.0:1786034582.713354:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:10468:x1872792608878464:12345-192.168.203.56@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1786034582.841811:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:10468:x1872792608878464:12345-192.168.203.56@tcp:44:lhsmtool_posix.0 Request processed in 128450us (133284us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034582.841852:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 80 00000001:00080000:3.0:1786034582.841889:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967342 is committed 00000001:00080000:3.0:1786034582.841913:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000020:00080000:3.0:1786034582.841920:0:5883:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1786034582.841936:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1786034582.841942:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1786034582.843025:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1786034582.843036:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1786034582.844018:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636170624:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786034582.844073:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034582.844851:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636170624 00000100:00100000:3.0:1786034582.844858:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636170624 00000100:00100000:3.0:1786034582.844915:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786034582.844924:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636170624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786034582.845072:0:6719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1786034582.845076:0:6719:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1786034581 00002000:00010000:3.0:1786034582.845078:0:6719:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786034582.845079:0:6719:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1786034581 -> 1786034581 00002000:00010000:3.0:1786034582.845081:0:6719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1786034582.845121:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636170624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 198us (1047us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1786034582.845128:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1786034582.845250:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1786034582.845790:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff964548a11500/2, rc 0, transno 4294967303 00000100:00100000:3.0:1786034582.845797:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636170624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786034582.847455:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034582.855967:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608878592 00000100:00100000:0.0:1786034582.855979:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608878592 00000100:00100000:0.0:1786034582.856055:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 30 00000100:00100000:0.0:1786034582.856065:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2365:x1872792608878592:12345-192.168.203.56@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1786034582.964604:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1786034582.964622:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1786034582.965338:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2365:x1872792608878592:12345-192.168.203.56@tcp:16:lhsmtool_posix.0 Request processed in 109270us (117881us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034582.965348:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 30 00000100:00100000:3.0:1786034582.982652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034582.982719:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608878848 00000100:00100000:2.0:1786034582.982728:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608878848 00000100:00100000:2.0:1786034582.982786:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 81 00000100:00100000:2.0:1786034582.982796:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:10468:x1872792608878848:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786034582.982976:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034582.983001:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40176 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758700 expref: 13 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034582.983022:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96454a119000) 00010000:00010000:2.0:1786034582.983025:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786034582.983050:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4018b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034582.983059:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4018b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034582.983065:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4018b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786034582.983270:0:5862:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000006d06a83e reply state 0000000019aeac8d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4018b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034582.983277:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786034582.983386:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:10468:x1872792608878848:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 590us (742us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1786034582.983394:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 81 00010000:00010000:0.0:1786034582.985283:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4018b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.985296:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4018b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.985303:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4018b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.985310:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034582.985314:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4018b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.985321:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4018b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.985334:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96454a119000) 00010000:00010000:0.0:1786034582.985336:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034582.985339:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4018b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034582.985346:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4018b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034582.991955:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034582.992093:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608878976 00000100:00100000:2.0:1786034582.992102:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608878976 00000100:00100000:2.0:1786034582.992152:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 31 00000100:00100000:2.0:1786034582.992170:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2364:x1872792608878976:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1786034582.992395:0:6719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1786034582.992398:0:6719:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1786034581 -> 1786034580 00002000:00010000:2.0:1786034582.992401:0:6719:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1786034578 00002000:00010000:2.0:1786034582.992403:0:6719:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1786034581 -> 1786034580 00002000:00010000:2.0:1786034582.992405:0:6719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1786034582.992498:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2364:x1872792608878976:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 Request processed in 338us (552us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1786034582.992515:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 31 00000100:00100000:1.0:1786034583.023240:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034583.023341:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608879232 00000100:00100000:0.0:1786034583.023350:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608879232 00000100:00100000:0.0:1786034583.023418:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 82 00000100:00100000:0.0:1786034583.023429:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:10468:x1872792608879232:12345-192.168.203.56@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1786034583.023498:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.023524:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40153 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f2 expref: 13 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.023534:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.023565:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f2 expref: 13 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.023577:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40153 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f2 expref: 13 pid: 5861 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034583.023591:0:5861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457dbc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636170752:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034583.023661:0:5861:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdaf00 going to sleep for 11 seconds 00000100:00080000:2.0:1786034583.023979:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034583.031300:0:5861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457dbc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636170752:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034583.031327:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034583.037388:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034583.037451:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608879360 00000100:00100000:2.0:1786034583.037460:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608879360 00010000:00010000:2.0:1786034583.037498:0:7671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40153 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f2 expref: 14 pid: 5861 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034583.037545:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 43 00000100:00100000:2.0:1786034583.037555:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:2362:x1872792608879360:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034583.037568:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034583.037574:0:7671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40153 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f2 expref: 14 pid: 5861 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.037587:0:7671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f2 expref: 14 pid: 5861 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.037605:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40153 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f2 expref: 14 pid: 5861 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.037617:0:7671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96454a119000) 00010000:00010000:2.0:1786034583.037622:0:7671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.037631:0:7671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.037637:0:7671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.037675:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034583.037722:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:2362:x1872792608879360:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 164us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034583.037730:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 43 00010000:00010000:1.0:1786034583.037782:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.037789:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.037814:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.037843:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.037851:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.037857:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034583.037868:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.037876:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.037885:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96454a119000) 00010000:00010000:1.0:1786034583.037888:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1786034583.037891:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.037897:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40192 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034583.037936:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+12:10468:x1872792608879232:12345-192.168.203.56@tcp:55:lhsmtool_posix.0 Request processed in 14509us (14704us total) trans 0 rc -22/-22 00000100:00100000:1.0:1786034583.037943:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 82 00000100:00100000:1.0:1786034583.040396:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034583.040453:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608879488 00000100:00100000:3.0:1786034583.040461:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608879488 00000100:00100000:3.0:1786034583.040511:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 32 00000100:00100000:3.0:1786034583.040521:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2363:x1872792608879488:12345-192.168.203.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786034583.040555:0:8676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000748c167a/0x490975051af40199 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.040574:0:8676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000767e893f/0x490975051af40184 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75870e expref: 7 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.040597:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786034583.040601:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786034583.040606:0:8676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748c167a/0x490975051af40199 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.040636:0:8676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000767e893f/0x490975051af40184 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75870e expref: 7 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.040649:0:8676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000767e893f/0x490975051af40184 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75870e expref: 7 pid: 8676 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034583.040664:0:8676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1872792636170880:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034583.040742:0:8676:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455d0a9900 going to sleep for 11 seconds 00000100:00100000:2.0:1786034583.062239:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034583.065308:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608879616 00000100:00100000:1.0:1786034583.065319:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608879616 00010000:00010000:1.0:1786034583.065356:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000767e893f/0x490975051af40184 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75870e expref: 8 pid: 8676 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034583.065396:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 44 00000100:00100000:1.0:1786034583.065406:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2362:x1872792608879616:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034583.065419:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034583.065441:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000767e893f/0x490975051af40184 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75870e expref: 8 pid: 8676 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.065466:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000767e893f/0x490975051af40184 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75870e expref: 8 pid: 8676 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.065492:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786034583.065496:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786034583.065511:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000748c167a/0x490975051af40199 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.065521:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748c167a/0x490975051af40199 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.065540:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034583.065588:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2362:x1872792608879616:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 184us (3358us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034583.065595:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 44 00010000:00010000:3.0:1786034583.070961:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000767e893f/0x490975051af40184 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75870e expref: 7 pid: 8676 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034583.070982:0:8676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1872792636170880:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034583.071003:0:8676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000748c167a/0x490975051af40199 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.071014:0:8676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000748c167a/0x490975051af40199 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.071022:0:8676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000748c167a/0x490975051af40199 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.071058:0:8676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000748c167a/0x490975051af40199 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.071066:0:8676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000748c167a/0x490975051af40199 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.071074:0:8676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000748c167a/0x490975051af40199 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.071081:0:8676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0000 already unused, calling callback (ffffffffc1761020) 00010000:00010000:3.0:1786034583.071085:0:8676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000748c167a/0x490975051af40199 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.071092:0:8676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000748c167a/0x490975051af40199 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.071108:0:8676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000748c167a/0x490975051af40199 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.071116:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000748c167a/0x490975051af40199 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034583.071235:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608879488:12345-192.168.203.56@tcp:1:lhsmtool_posix.0 Request processed in 30715us (30842us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034583.071245:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 32 00000100:00100000:2.0:1786034583.078552:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034583.078855:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608879872 00000100:00100000:1.0:1786034583.078864:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608879872 00000100:00100000:1.0:1786034583.078914:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 83 00000100:00100000:1.0:1786034583.078923:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+12:10468:x1872792608879872:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786034583.078997:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af401a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.079014:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af401a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.079025:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af401a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.079214:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.079226:0:6743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af40161 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f9 expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.079234:0:6743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.079265:0:6743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af40161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f9 expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.079278:0:6743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af40161 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f9 expref: 13 pid: 5863 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034583.079291:0:6743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6743:1872792636171008:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034583.079370:0:6743:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf780 going to sleep for 11 seconds 00000100:00100000:3.0:1786034583.083135:0:6743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6743:1872792636171008:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034583.083161:0:6743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034583.084663:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034583.084926:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608880000 00000100:00100000:0.0:1786034583.084934:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608880000 00010000:00010000:0.0:1786034583.084968:0:7671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af40161 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f9 expref: 14 pid: 5863 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034583.085004:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 45 00000100:00100000:0.0:1786034583.085014:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:2362:x1872792608880000:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034583.085027:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034583.085034:0:7671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af40161 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f9 expref: 14 pid: 5863 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.085057:0:7671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af40161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f9 expref: 14 pid: 5863 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.085079:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af40161 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586f9 expref: 14 pid: 5863 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.085091:0:7671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96454a119000) 00010000:00010000:0.0:1786034583.085096:0:7671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.085104:0:7671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.085112:0:7671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.085135:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034583.085177:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:2362:x1872792608880000:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 164us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034583.085185:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 45 00010000:00010000:1.0:1786034583.085332:0:6743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.085339:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786034583.085559:0:6743:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1786034583.085974:0:6743:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1786034583.086021:0:6743:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1786034583.086093:0:6743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6743:1872792636171136:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786034583.086135:0:6743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034583.086167:0:6743:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf840 going to sleep for 11 seconds 00000100:00100000:0.0:1786034583.086229:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636171136 00000100:00100000:0.0:1786034583.086234:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636171136 00000100:00100000:0.0:1786034583.086265:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786034583.086271:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6743:x1872792636171136:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786034583.086349:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6743:x1872792636171136:12345-0@lo:1000:mdt00_003.0 Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034583.086357:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786034583.086415:0:6743:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1786034583.086420:0:6743:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff964548a11500, transno 4294967303 00000100:00100000:3.0:1786034583.086437:0:6743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6743:1872792636171136:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1786034583.086860:0:6743:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1786034583.086903:0:6743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574c97480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6743:1872792636171264:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786034583.087093:0:6743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034583.087112:0:6743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1786034583.087125:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636171264 00000100:00100000:3.0:1786034583.087129:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636171264 00000100:00100000:3.0:1786034583.087147:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786034583.087153:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6743:x1872792636171264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786034583.087289:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6743:x1872792636171264:12345-0@lo:1000:mdt00_003.0 Request processed in 135us (195us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1786034583.087296:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786034583.087323:0:6743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574c97480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6743:1872792636171264:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1786034583.087344:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087352:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087360:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087377:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034583.087381:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087389:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087402:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96454a119000) 00010000:00010000:3.0:1786034583.087405:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786034583.087409:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087416:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af401a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087447:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087454:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087460:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087465:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034583.087467:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087472:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087490:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119c00) 00010000:00010000:3.0:1786034583.087492:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786034583.087495:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087500:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af400dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087530:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087542:0:6743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af400f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586dd expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087549:0:6743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087568:0:6743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af400f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586dd expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.087580:0:6743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af400f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586dd expref: 16 pid: 5861 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034583.087590:0:6743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6743:1872792636171392:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034583.087637:0:6743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645411c8480 going to sleep for 11 seconds 00000100:00100000:3.0:1786034583.091967:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457dbc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636171520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786034583.092024:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034583.092112:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636171520 00000100:00100000:0.0:1786034583.092119:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636171520 00000100:00100000:0.0:1786034583.092183:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1786034583.092192:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1872792636171520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034583.092223:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034583.092262:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1872792636171520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034583.092269:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1786034583.092438:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786034583.092481:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457dbc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636171520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786034583.092657:0:6743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6743:1872792636171392:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034583.092674:0:6743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034583.096138:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034583.103954:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608880128 00000100:00100000:2.0:1786034583.103967:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608880128 00010000:00010000:2.0:1786034583.104005:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af400f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586dd expref: 17 pid: 5861 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034583.104039:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 46 00000100:00100000:2.0:1786034583.104048:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+17:2363:x1872792608880128:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034583.104061:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034583.104067:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af400f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586dd expref: 17 pid: 5861 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.104080:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af400f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586dd expref: 17 pid: 5861 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.104102:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af400f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7586dd expref: 17 pid: 5861 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.104114:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119c00) 00010000:00010000:2.0:1786034583.104118:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.104138:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.104145:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.104168:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034583.104362:0:6743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104370:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104432:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104439:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104445:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104451:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034583.104455:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104462:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104471:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119c00) 00010000:00010000:3.0:1786034583.104474:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034583.104478:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104495:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104525:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af401a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104532:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af401a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104539:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af401a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104544:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034583.104547:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af401a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104554:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af401a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104562:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119c00) 00010000:00010000:3.0:1786034583.104564:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786034583.104567:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af401a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.104573:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af401a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034583.104862:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:2363:x1872792608880128:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 812us (8728us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034583.104870:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 46 00000040:00080000:0.0:1786034583.105020:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786034583.105025:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786034583.105049:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1786034583.105055:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786034583.109973:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:10468:x1872792608879872:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 31042us (31419us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1786034583.109987:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 83 00000020:00080000:3.0:1786034583.110000:0:6743:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1786034583.121787:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034583.121907:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608880384 00000100:00100000:0.0:1786034583.121915:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608880384 00000100:00100000:0.0:1786034583.121961:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00100000:0.0:1786034583.121971:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:10468:x1872792608880384:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1786034583.122806:0:5864:0:(mdd_object.c:4291:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1786034583.122959:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1786034583.123003:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af401b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.123181:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af401b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.123246:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af401b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.123256:0:5864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af401b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.123272:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af401b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.123278:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af401b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.123322:0:5864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786034583.123410:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+17:10468:x1872792608880384:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 Request processed in 1439us (1628us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1786034583.123419:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 20 00000020:00080000:0.0:1786034583.123424:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786034583.131323:0:7670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034583.131337:0:7670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af401b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.131347:0:7670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8c00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:3.0:1786034583.131351:0:7670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af401b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.131361:0:7670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af401b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.131912:0:7670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:3.0:1786034583.131916:0:7670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786034583.131920:0:7670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af401b5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.131927:0:7670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af401b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.132011:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034583.132014:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034583.132016:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786034583.178952:0:12042:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786034583.178961:0:12042:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786034583.178998:0:12042:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1786034583.179003:0:12042:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786034583.217648:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034583.404443:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034583.405757:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608880640 00000100:00100000:2.0:1786034583.405767:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608880640 00000100:00100000:2.0:1786034583.405816:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 84 00000100:00100000:2.0:1786034583.405842:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+17:10478:x1872792608880640:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:2.0:1786034583.405862:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034583.405881:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af401bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758715 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.406097:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7a00/0x490975051af401c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.406111:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7a00/0x490975051af401c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.406122:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7a00/0x490975051af401c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034583.406133:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1786034583.407629:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af401bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758715 expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.407647:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7a00/0x490975051af401c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758715 expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.407655:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:2.0:1786034583.407657:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786034583.407660:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7a00, rc 0) 00000100:00100000:2.0:1786034583.407731:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:10478:x1872792608880640:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 1907us (3296us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1786034583.407740:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 84 00000100:00100000:3.0:1786034583.421978:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034583.422009:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608880768 00000100:00100000:3.0:1786034583.422017:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608880768 00000100:00100000:3.0:1786034583.422060:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 85 00000100:00100000:3.0:1786034583.422069:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:10478:x1872792608880768:12345-192.168.203.56@tcp:34:lfs.0 00010000:00010000:3.0:1786034583.422140:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.422266:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.422277:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.422293:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af401d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.422301:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af401d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.422307:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af401d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.422586:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af401df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.422595:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af401df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.422603:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af401df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786034583.422640:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af401df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.422651:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.422656:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.422673:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423014:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034583.423019:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423029:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423040:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:3.0:1786034583.423044:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034583.423048:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423055:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af401d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423067:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af401d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423073:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af401d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423080:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af401d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423085:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034583.423088:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af401d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423104:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af401d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423112:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96454a119c00) 00010000:00010000:3.0:1786034583.423114:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034583.423117:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af401d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423124:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af401d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423138:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af401df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423145:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af401df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423151:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af401df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423156:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034583.423220:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af401df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423227:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af401df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423234:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119000) 00010000:00010000:3.0:1786034583.423236:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034583.423239:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af401df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.423255:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af401df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034583.423331:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:10478:x1872792608880768:12345-192.168.203.56@tcp:34:lfs.0 Request processed in 1261us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034583.423339:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 85 00000100:00100000:2.0:1786034583.493314:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034583.494475:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608881024 00000100:00100000:1.0:1786034583.494485:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608881024 00000100:00100000:2.0:1786034583.494694:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 86 00000100:00100000:2.0:1786034583.494706:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:10481:x1872792608881024:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:2.0:1786034583.494725:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034583.494745:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af401e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75871c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.494812:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af401ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.494842:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af401ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.494854:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af401ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.494869:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af401f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.494888:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af401f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.494895:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af401f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495344:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af401fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495355:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af401fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495363:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af401fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034583.495373:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1786034583.495461:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af401ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495469:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af401ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495477:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af401ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495484:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034583.495488:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af401ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495495:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af401ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495526:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:2.0:1786034583.495529:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034583.495533:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af401ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495538:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af401ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495550:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af401f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495555:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af401f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495561:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af401f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495565:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034583.495568:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af401f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495574:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af401f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495580:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96455a530a00) 00010000:00010000:2.0:1786034583.495582:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034583.495585:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af401f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495590:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af401f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495634:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af401e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75871c expref: 22 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495648:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af401fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75871c expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.495655:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96455a530400) 00010000:00010000:2.0:1786034583.495657:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786034583.495660:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6e00, rc 0) 00000100:00100000:2.0:1786034583.495908:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:10481:x1872792608881024:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 1204us (2600us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1786034583.495916:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 86 00000100:00100000:0.0:1786034583.502951:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034583.503116:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608881152 00000100:00100000:3.0:1786034583.503125:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608881152 00000100:00100000:3.0:1786034583.503307:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 87 00000100:00100000:3.0:1786034583.503317:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:10481:x1872792608881152:12345-192.168.203.56@tcp:54:lfs.0 00010000:00010000:3.0:1786034583.503376:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.503393:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.503403:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.503429:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.503437:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40209 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.503443:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.503449:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034583.503453:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.503471:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.503482:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96455a530400) 00010000:00010000:3.0:1786034583.503485:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786034583.503489:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40209 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.503497:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034583.503573:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:10481:x1872792608881152:12345-192.168.203.56@tcp:54:lfs.0 Request processed in 258us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034583.503581:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 87 00000100:00100000:3.0:1786034583.516669:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034583.517526:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608881408 00000100:00100000:0.0:1786034583.517536:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608881408 00000100:00100000:0.0:1786034583.517592:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 21 00000100:00100000:0.0:1786034583.517601:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542eedc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:10481:x1872792608881408:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:0.0:1786034583.517864:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542eedc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+22:10481:x1872792608881408:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 262us (1202us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1786034583.517872:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 21 00000100:00100000:2.0:1786034583.574417:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034583.574639:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608881664 00000100:00100000:1.0:1786034583.574649:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608881664 00000100:00100000:1.0:1786034583.574705:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 88 00000100:00100000:1.0:1786034583.574722:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+22:10009:x1872792608881664:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:1.0:1786034583.574745:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034583.574763:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40210 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758723 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.574883:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.574897:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af401fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75871c expref: 23 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.574906:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.574936:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af401fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75871c expref: 23 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034583.574949:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af401fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75871c expref: 23 pid: 5863 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034583.574963:0:5861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636171648:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034583.575059:0:5861:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034583.576663:0:5861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636171648:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034583.576687:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034583.577452:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034583.577571:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608881792 00000100:00100000:0.0:1786034583.577577:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608881792 00010000:00010000:0.0:1786034583.577607:0:7671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af401fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75871c expref: 24 pid: 5863 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034583.577638:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 47 00000100:00100000:0.0:1786034583.577659:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:2363:x1872792608881792:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034583.577672:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034583.577678:0:7671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af401fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75871c expref: 24 pid: 5863 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.577690:0:7671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af401fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75871c expref: 24 pid: 5863 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.577708:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af401fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75871c expref: 24 pid: 5863 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.577728:0:7671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96455a530400) 00010000:00010000:0.0:1786034583.577733:0:7671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.577741:0:7671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.577748:0:7671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.577771:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034583.577815:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+23:2363:x1872792608881792:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 157us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034583.577849:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 47 00010000:00010000:2.0:1786034583.578362:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.578379:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034583.578396:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1786034583.578541:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40210 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758723 expref: 24 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.578569:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758723 expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.578577:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96455a530400) 00010000:00010000:2.0:1786034583.578580:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786034583.578582:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01200, rc 0) 00000100:00100000:2.0:1786034583.578620:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+23:10009:x1872792608881664:12345-192.168.203.56@tcp:101:bash.0 Request processed in 3906us (4211us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1786034583.578627:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 88 00000100:00100000:2.0:1786034583.588966:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034583.589027:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608882048 00000100:00100000:0.0:1786034583.589037:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608882048 00000100:00100000:0.0:1786034583.589097:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 89 00000100:00100000:0.0:1786034583.589107:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+23:10009:x1872792608882048:12345-192.168.203.56@tcp:36:bash.0 00010000:00010000:0.0:1786034583.589365:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40225 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.589392:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40225 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.589407:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40225 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786034583.589458:0:6743:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1786034583.589482:0:6743:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000bf1e2225 reply state 0000000043a969e1 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40225 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034583.589490:0:6743:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1786034583.589548:0:6743:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1786034583.589645:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:10009:x1872792608882048:12345-192.168.203.56@tcp:36:bash.0 Request processed in 538us (686us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1786034583.589652:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 89 00000020:00080000:0.0:1786034583.589657:0:6743:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1786034583.592707:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40225 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.592721:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40225 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.592729:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40225 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.592735:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034583.592740:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40225 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.592748:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40225 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.592780:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96455a530400) 00010000:00010000:3.0:1786034583.592782:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034583.592787:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40225 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.592793:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40225 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034583.596538:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034583.596807:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608882176 00000100:00100000:0.0:1786034583.596816:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608882176 00000100:00100000:0.0:1786034583.596898:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 90 00000100:00100000:0.0:1786034583.596907:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:10009:x1872792608882176:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:0.0:1786034583.596930:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034583.596949:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4022c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75872a expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.597006:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4022c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75872a expref: 27 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.597038:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4022c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75872a expref: 27 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.597057:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96455a530400) 00010000:00010000:0.0:1786034583.597060:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786034583.597063:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9600, rc 0) 00000100:00100000:0.0:1786034583.597123:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:10009:x1872792608882176:12345-192.168.203.56@tcp:101:bash.0 Request processed in 207us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034583.597130:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 90 00000100:00100000:1.0:1786034583.601521:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034583.601592:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608882304 00000100:00100000:3.0:1786034583.601601:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608882304 00000100:00100000:3.0:1786034583.601650:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 33 00000100:00100000:3.0:1786034583.601661:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964559c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:10009:x1872792608882304:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:3.0:1786034583.601678:0:6720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034583.601698:0:6720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a132bfc/0x490975051af40233 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758731 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786034583.601723:0:6720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a74b994, atime: 0x6a74b992, ctime: 0x6a74b994, blocks: 0xb 00010000:00010000:3.0:1786034583.601742:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1786034583.601747:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034583.601754:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a132bfc/0x490975051af40233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758731 expref: 7 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.601767:0:6720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003a132bfc/0x490975051af40233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758731 expref: 7 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.601985:0:6720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f1c00, rc 0) 00000100:00100000:3.0:1786034583.602041:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964559c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:10009:x1872792608882304:12345-192.168.203.56@tcp:101:bash.0 Request processed in 382us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034583.602059:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 33 00000100:00100000:1.0:1786034583.609864:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034583.610025:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608882432 00000100:00100000:2.0:1786034583.610034:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608882432 00002000:00010000:2.0:1786034583.610075:0:6725:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1786034583.610080:0:6725:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9645777a3100 with x1872792608882432 ext(0->18446744073709551615) 00002000:00010000:2.0:1786034583.610092:0:6725:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9645777a3100. 00000100:00100000:2.0:1786034583.610127:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 1 00000100:00100000:2.0:1786034583.610137:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2362:x1872792608882432:12345-192.168.203.56@tcp:10:bash.0 00002000:00010000:2.0:1786034583.610402:0:6725:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1786034583.610407:0:6725:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1786034580 -> 1786034582 00002000:00010000:2.0:1786034583.610409:0:6725:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1786034578 -> 1786034578 00002000:00010000:2.0:1786034583.610412:0:6725:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1786034580 -> 1786034582 00002000:00010000:2.0:1786034583.610414:0:6725:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1786034583.610487:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2362:x1872792608882432:12345-192.168.203.56@tcp:10:bash.0 Request processed in 351us (630us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1786034583.610517:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 1 00002000:00010000:2.0:1786034583.610521:0:6725:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1786034583.610523:0:6725:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9645777a3100 with x1872792608882432 ext(0->18446744073709551615) 00002000:00010000:2.0:1786034583.610528:0:6725:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9645777a3100. 00000100:00100000:2.0:1786034583.732392:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034583.732475:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608882560 00000100:00100000:0.0:1786034583.732484:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608882560 00000100:00100000:0.0:1786034583.732551:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 91 00000100:00100000:0.0:1786034583.732561:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:10495:x1872792608882560:12345-192.168.203.56@tcp:34:lfs.0 00010000:00010000:0.0:1786034583.733624:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4023a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.733644:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4023a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.733654:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4023a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.733668:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40241 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.733675:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.733698:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734005:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40248 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734015:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734022:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786034583.734058:0:6743:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734069:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4023a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734075:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4023a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734081:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4023a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734087:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034583.734091:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4023a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734098:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4023a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734109:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:0.0:1786034583.734119:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034583.734123:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4023a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734130:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4023a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734141:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734147:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40241 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734152:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40241 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734156:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034583.734159:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40241 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734164:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40241 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734170:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff964547ee4800) 00010000:00010000:0.0:1786034583.734173:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034583.734175:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40241 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734181:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40241 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734771:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734784:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40248 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734789:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40248 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734794:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034583.734798:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40248 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734803:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40248 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734811:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96455a530400) 00010000:00010000:0.0:1786034583.734813:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034583.734816:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40248 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.734902:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40248 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034583.735730:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:10495:x1872792608882560:12345-192.168.203.56@tcp:34:lfs.0 Request processed in 3158us (3334us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034583.735741:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 91 00000100:00100000:1.0:1786034583.813323:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034583.813410:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608882816 00000100:00100000:0.0:1786034583.813420:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608882816 00000100:00100000:0.0:1786034583.813475:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 92 00000100:00100000:0.0:1786034583.813484:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:10498:x1872792608882816:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034583.813511:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034583.813532:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4024f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758738 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.813605:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40256 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.813630:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40256 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.813644:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40256 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.813660:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4025d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.813668:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4025d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.813675:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4025d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.813997:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40264 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814008:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814027:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034583.814038:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1786034583.814130:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40256 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814138:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40256 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814144:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40256 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814157:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034583.814161:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40256 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814168:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40256 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814180:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:0.0:1786034583.814183:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034583.814199:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40256 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814206:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40256 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814218:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4025d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814224:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4025d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814229:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4025d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814234:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034583.814236:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4025d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814242:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4025d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814259:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff964547ee4800) 00010000:00010000:0.0:1786034583.814261:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034583.814263:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4025d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814269:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4025d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814307:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4024f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758738 expref: 30 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814320:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758738 expref: 29 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.814327:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96455a530400) 00010000:00010000:0.0:1786034583.814329:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786034583.814332:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9400, rc 0) 00000100:00100000:0.0:1786034583.814395:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:10498:x1872792608882816:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 913us (1080us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1786034583.814403:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 92 00000100:00100000:2.0:1786034583.818181:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034583.818872:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608882944 00000100:00100000:3.0:1786034583.818881:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608882944 00000100:00100000:3.0:1786034583.818935:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 93 00000100:00100000:3.0:1786034583.818944:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:10498:x1872792608882944:12345-192.168.203.56@tcp:54:lfs.0 00010000:00010000:3.0:1786034583.819001:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.819027:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758723 expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.819037:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.819072:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758723 expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.819085:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758723 expref: 29 pid: 5861 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034583.819100:0:5862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964547678a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636171776:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034583.819172:0:5862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca480 going to sleep for 11 seconds 00000100:00100000:3.0:1786034583.821085:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034583.821174:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608883200 00000100:00100000:0.0:1786034583.821181:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608883200 00000100:00100000:0.0:1786034583.821227:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:0.0:1786034583.821236:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454767aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+30:5609:x1872792608883200:12345-192.168.203.56@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786034583.821510:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454767aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:5609:x1872792608883200:12345-192.168.203.56@tcp:35:ldlm_bl.0 Request processed in 274us (427us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1786034583.821518:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:2.0:1786034583.821727:0:5862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964547678a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636171776:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034583.821750:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034583.822883:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034583.822940:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608883328 00000100:00100000:2.0:1786034583.822947:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608883328 00010000:00010000:2.0:1786034583.822972:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758723 expref: 31 pid: 5861 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034583.823007:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 48 00000100:00100000:2.0:1786034583.823022:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:2362:x1872792608883328:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034583.823034:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034583.823040:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758723 expref: 31 pid: 5861 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.823052:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758723 expref: 31 pid: 5861 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.823073:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40217 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758723 expref: 31 pid: 5861 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.823101:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96455a530400) 00010000:00010000:2.0:1786034583.823106:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.823114:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.823121:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034583.823145:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034583.823185:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+30:2362:x1872792608883328:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 164us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034583.823192:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 48 00010000:00010000:3.0:1786034583.823605:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.823613:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.823645:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.823652:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.823658:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.823663:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034583.823667:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.823674:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.823683:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96455a530400) 00010000:00010000:3.0:1786034583.823685:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786034583.823689:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034583.823695:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40272 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034583.823748:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:10498:x1872792608882944:12345-192.168.203.56@tcp:54:lfs.0 Request processed in 4805us (5575us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034583.823756:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 93 00000100:00100000:0.0:1786034583.829485:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034583.829767:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608883584 00000100:00100000:3.0:1786034583.829776:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608883584 00000100:00100000:3.0:1786034583.829860:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 23 00000100:00100000:3.0:1786034583.829881:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:10498:x1872792608883584:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:3.0:1786034583.830098:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+30:10498:x1872792608883584:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 217us (629us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1786034583.830106:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 23 00000100:00100000:2.0:1786034583.958437:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034583.960352:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608883840 00000100:00100000:0.0:1786034583.960364:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608883840 00000100:00100000:0.0:1786034583.960429:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 94 00000100:00100000:0.0:1786034583.960440:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+30:10509:x1872792608883840:12345-192.168.203.56@tcp:101:cat.0 00010000:00010000:0.0:1786034583.960463:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034583.960485:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40279 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75873f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.960563:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40280 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.960578:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40280 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.960602:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40280 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.960617:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.960625:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.960632:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.960958:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af4028e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.960967:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af4028e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.960981:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af4028e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034583.960991:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1786034583.962172:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40280 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.962182:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40280 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.962188:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40280 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.962194:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034583.963092:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40280 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.963103:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40280 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.963119:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:0.0:1786034583.963122:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034583.963127:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40280 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.963134:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40280 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.963147:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.963154:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40287 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.963170:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.963175:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034583.963178:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.963183:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40287 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.963190:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff964547ee4800) 00010000:00010000:0.0:1786034583.963192:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034583.963195:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40287 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.963260:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40287 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.963312:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40279 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75873f expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.963326:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af4028e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75873f expref: 32 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034583.963334:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96455a530400) 00010000:00010000:0.0:1786034583.963336:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786034583.963339:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8e00, rc 0) 00000100:00100000:0.0:1786034583.963464:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:10509:x1872792608883840:12345-192.168.203.56@tcp:101:cat.0 Request processed in 3026us (5039us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1786034583.963482:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 94 00000100:00100000:1.0:1786034583.990899:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034583.990995:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608884096 00000100:00100000:3.0:1786034583.991009:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608884096 00000100:00100000:3.0:1786034583.991078:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 24 00000100:00100000:3.0:1786034583.991090:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:10509:x1872792608884096:12345-192.168.203.56@tcp:35:cat.0 00000100:00100000:3.0:1786034583.991395:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:10509:x1872792608884096:12345-192.168.203.56@tcp:35:cat.0 Request processed in 306us (569us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1786034583.991404:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 24 00000100:00100000:1.0:1786034584.022971:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034584.033377:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608884352 00000100:00100000:3.0:1786034584.033396:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608884352 00000100:00100000:3.0:1786034584.033504:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 95 00000100:00100000:3.0:1786034584.033517:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:10510:x1872792608884352:12345-192.168.203.56@tcp:36:rm.0 00010000:00010000:3.0:1786034584.033596:0:6743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1786034584.033631:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af4028e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75873f expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.033658:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40264 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758738 expref: 32 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.033673:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4022c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75872a expref: 31 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.033697:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96455a530400) 00010000:00010000:3.0:1786034584.033735:0:6743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034584.033763:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4029c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.033779:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4029c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.033790:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4029c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.033806:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af402a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.033814:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af402a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.034291:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af402a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.034697:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af402aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.034708:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af402aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.035815:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af402aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786034584.036571:0:6743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1786034584.036582:0:6743:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 420244757641ns, next at 421244754851ns, rc = 0 00010000:00010000:3.0:1786034584.036650:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af402b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036674:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af402b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036683:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af402b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036691:0:6743:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af402b1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036697:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af402b1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036703:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af402b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036745:0:6743:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786034584.036773:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af402aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036779:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af402aa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036784:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af402aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036789:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034584.036794:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af402aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036801:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af402aa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036846:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119e00) 00010000:00010000:3.0:1786034584.036850:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786034584.036855:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af402aa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036860:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af402aa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036880:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4029c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036886:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4029c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036892:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4029c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036897:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034584.036900:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4029c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036906:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4029c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036913:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:3.0:1786034584.036916:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034584.036918:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4029c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.036924:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4029c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786034584.036946:0:6743:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000fce2f389 reply state 00000000bf5c2e03 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af402a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034584.036955:0:6743:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786034584.037068:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:10510:x1872792608884352:12345-192.168.203.56@tcp:36:rm.0 Request processed in 3549us (14105us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1786034584.037078:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 95 00010000:00010000:0.0:1786034584.037475:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034584.037483:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af402b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.037489:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0200 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034584.037493:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af402b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.037508:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af402b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.037518:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96454a119e00) 00010000:00010000:0.0:1786034584.037521:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786034584.037523:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af402b1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.037528:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af402b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.037543:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034584.037544:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034584.037546:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034584.049288:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af402a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.049309:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af402a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.049317:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af402a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.049360:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034584.049367:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af402a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.049376:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af402a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.049397:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96454a119300) 00010000:00010000:0.0:1786034584.049401:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034584.049406:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af402a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.049413:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af402a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034584.111451:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034584.111600:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608884608 00000100:00100000:1.0:1786034584.111612:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608884608 00000100:00100000:1.0:1786034584.111692:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 96 00000100:00100000:1.0:1786034584.111703:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:10516:x1872792608884608:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:1.0:1786034584.111741:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034584.111767:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af402b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758746 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.111985:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af402bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.112002:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af402bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.112015:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af402bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.112032:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af402c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.112061:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af402c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.112069:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af402c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786034584.112684:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1786034584.112879:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af402cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.112888:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af402cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.112896:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af402cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.112933:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af402bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.112941:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af402bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.112949:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af402bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.112956:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034584.112961:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af402bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.112969:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af402bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.112994:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:1.0:1786034584.112998:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034584.113003:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af402bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.113011:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af402bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786034584.113025:0:5861:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000079051974 reply state 00000000d0f03d59 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af402c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034584.113035:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786034584.113062:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af402b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758746 expref: 34 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.113077:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af402cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758746 expref: 33 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.113085:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9645521d1e00) 00010000:00010000:1.0:1786034584.113087:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034584.113090:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00a00, rc 0) 00000100:00100000:1.0:1786034584.113156:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+34:10516:x1872792608884608:12345-192.168.203.56@tcp:101:bash.0 Request processed in 1454us (1718us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1786034584.113164:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 96 00010000:00010000:3.0:1786034584.116254:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af402c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.116270:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af402c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.116278:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af402c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.116284:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034584.116289:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af402c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.116297:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af402c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.116312:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9645521d1200) 00010000:00010000:3.0:1786034584.116316:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034584.116320:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af402c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.116327:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af402c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034584.117763:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034584.117876:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608884736 00000100:00100000:0.0:1786034584.117887:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608884736 00000100:00100000:0.0:1786034584.117957:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 34 00000100:00100000:0.0:1786034584.117969:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2363:x1872792608884736:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:0.0:1786034584.117989:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034584.118013:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b367a834/0x490975051af402db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75874d expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786034584.118043:0:6721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786034584.118065:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=420s v=(0 0) 00010000:00010000:0.0:1786034584.118070:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786034584.118080:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b367a834/0x490975051af402db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75874d expref: 8 pid: 6721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.118115:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b367a834/0x490975051af402db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75874d expref: 8 pid: 6721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.118129:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9a00, rc 0) 00000100:00100000:0.0:1786034584.118183:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2363:x1872792608884736:12345-192.168.203.56@tcp:101:bash.0 Request processed in 216us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034584.118191:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 34 00000100:00080000:3.0:1786034584.118786:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786034584.130443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034584.130550:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608884864 00000100:00100000:1.0:1786034584.130563:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608884864 00000100:00100000:1.0:1786034584.130638:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 35 00000100:00100000:1.0:1786034584.130651:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:10516:x1872792608884864:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:1.0:1786034584.130698:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034584.130731:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758754 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.130773:0:6719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b367a834/0x490975051af402db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75874d expref: 9 pid: 6721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.130783:0:6719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034584.130788:0:6719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034584.130794:0:6719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 9 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.131155:0:6719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b367a834/0x490975051af402db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75874d expref: 9 pid: 6721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.131171:0:6719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b367a834/0x490975051af402db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75874d expref: 9 pid: 6721 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034584.131199:0:6719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6719:1872792636171904:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034584.131314:0:6719:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf840 going to sleep for 11 seconds 00000100:00100000:2.0:1786034584.136624:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034584.136774:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608884992 00000100:00100000:0.0:1786034584.136785:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608884992 00010000:00010000:0.0:1786034584.136875:0:7671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b367a834/0x490975051af402db lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75874d expref: 10 pid: 6721 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034584.136921:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 49 00000100:00100000:0.0:1786034584.136932:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454acee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:2362:x1872792608884992:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034584.136950:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034584.136979:0:7671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b367a834/0x490975051af402db lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75874d expref: 10 pid: 6721 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.136996:0:7671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b367a834/0x490975051af402db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75874d expref: 10 pid: 6721 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.137027:0:7671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786034584.137033:0:7671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786034584.137042:0:7671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 10 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.137066:0:7671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 10 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.137113:0:7671:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 10 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034584.137130:0:7671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457dbc5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7671:1872792636172032:192.168.203.56@tcp:105: 00000100:00100000:0.0:1786034584.137329:0:7671:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cda480 going to sleep for 11 seconds 00010000:00010000:1.0:1786034584.139085:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b367a834/0x490975051af402db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75874d expref: 10 pid: 6721 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034584.139107:0:6719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6719:1872792636171904:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034584.139142:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 9 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.139170:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00e00, rc 0) 00000100:00100000:1.0:1786034584.139245:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:10516:x1872792608884864:12345-192.168.203.56@tcp:101:bash.0 Request processed in 8596us (8814us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034584.139253:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 35 00000100:00100000:0.0:1786034584.141310:0:7671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457dbc5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7671:1872792636172032:192.168.203.56@tcp:105: 00010000:00010000:0.0:1786034584.141330:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034584.141375:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454acee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2362:x1872792608884992:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 4444us (4771us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034584.141790:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 49 00000100:00100000:2.0:1786034584.142357:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034584.149985:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608885248 00000100:00100000:3.0:1786034584.150006:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608885248 00000100:00100000:3.0:1786034584.150088:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 25 00000100:00100000:3.0:1786034584.150100:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:10516:x1872792608885248:12345-192.168.203.56@tcp:35:bash.0 00000100:00100000:3.0:1786034584.151515:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+34:10516:x1872792608885248:12345-192.168.203.56@tcp:35:bash.0 Request processed in 1413us (9155us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1786034584.151526:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 25 00010000:00010000:0.0:1786034584.240583:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034584.479120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034584.479216:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608885376 00000100:00100000:0.0:1786034584.479228:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608885376 00000100:00100000:0.0:1786034584.479293:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 97 00000100:00100000:0.0:1786034584.479304:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+34:10532:x1872792608885376:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034584.479335:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034584.479358:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af402e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75875b expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.479443:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af402f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.479482:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af402f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.479504:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af402f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034584.479573:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1786034584.479577:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034584.479599:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af402f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.479624:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af402e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75875b expref: 36 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.479644:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af402f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75875b expref: 35 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.479653:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:0.0:1786034584.479656:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034584.479659:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8c00, rc 0) 00000100:00100000:0.0:1786034584.483021:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+35:10532:x1872792608885376:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 3706us (3901us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034584.483034:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 97 00000100:00100000:2.0:1786034584.502722:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034584.502819:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608885632 00000100:00100000:1.0:1786034584.502866:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608885632 00000100:00100000:1.0:1786034584.502929:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 98 00000100:00100000:1.0:1786034584.502941:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+35:10532:x1872792608885632:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:1.0:1786034584.502977:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034584.503003:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af402f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758762 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.503134:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af402fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.503153:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af402fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.503166:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af402fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034584.503178:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1786034584.503347:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af402f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758762 expref: 38 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.503366:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af402fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758762 expref: 37 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.503396:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9645521d1e00) 00010000:00010000:1.0:1786034584.503399:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034584.503404:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01c00, rc 0) 00000100:00100000:1.0:1786034584.503477:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:10532:x1872792608885632:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 538us (779us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1786034584.503484:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 98 00000100:00100000:2.0:1786034584.527403:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034584.527518:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608885760 00000100:00100000:1.0:1786034584.527530:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608885760 00000100:00100000:1.0:1786034584.527613:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 6 00000100:00100000:1.0:1786034584.527625:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:2363:x1872792608885760:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034584.527644:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034584.527676:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af402fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758762 expref: 37 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.527700:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9645521d1e00) 00010000:00010000:1.0:1786034584.527706:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034584.527785:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+36:2363:x1872792608885760:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 163us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034584.527794:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 6 00000100:00100000:2.0:1786034584.531730:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034584.531863:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608886016 00000100:00100000:3.0:1786034584.531876:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608886016 00000100:00100000:3.0:1786034584.531943:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 99 00000100:00100000:3.0:1786034584.531963:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+36:10532:x1872792608886016:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034584.531991:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034584.532016:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4030c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758769 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.532143:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40313 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.532161:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.532174:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034584.532188:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1786034584.532332:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4030c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758769 expref: 39 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.532370:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40313 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758769 expref: 38 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.532381:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9645521d1e00) 00010000:00010000:3.0:1786034584.532384:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786034584.532388:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0800, rc 0) 00000100:00100000:3.0:1786034584.532466:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+38:10532:x1872792608886016:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 506us (756us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1786034584.532474:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 99 00000100:00100000:2.0:1786034584.544662:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034584.544763:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608886144 00000100:00100000:0.0:1786034584.544776:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608886144 00000100:00100000:0.0:1786034584.544870:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 36 00000100:00100000:0.0:1786034584.544882:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2364:x1872792608886144:12345-192.168.203.56@tcp:1:lfs.0 00010000:00010000:0.0:1786034584.544938:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000950c883/0x490975051af40321 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.544988:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 8 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.544997:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786034584.545002:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786034584.545007:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000950c883/0x490975051af40321 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.545054:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 8 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.545069:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 8 pid: 6719 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034584.545087:0:6721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457dbc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6721:1872792636172160:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034584.545205:0:6721:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cda840 going to sleep for 11 seconds 00000100:00100000:0.0:1786034584.551869:0:6721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457dbc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6721:1872792636172160:192.168.203.56@tcp:104: 00010000:00010000:0.0:1786034584.551910:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000950c883/0x490975051af40321 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034584.554481:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034584.554751:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608886272 00000100:00100000:1.0:1786034584.554763:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608886272 00002000:00100000:1.0:1786034584.554871:0:6727:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff964574d17100 x1872792608886272/t0(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:555/0 lens 504/0 e 0 to 0 dl 1786034595 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786034584.554883:0:6727:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574d17100 with x1872792608886272 ext(0->8) 00010000:00010000:1.0:1786034584.554893:0:6727:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 9 pid: 6719 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.554929:0:6727:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 9 pid: 6719 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786034584.554938:0:6727:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff964574d17100 00000100:00100000:1.0:1786034584.554982:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 1 00000100:00100000:1.0:1786034584.554993:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2362:x1872792608886272:12345-192.168.203.56@tcp:4:lfs.0 00000100:00100000:1.0:1786034584.555550:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+11:2362:x1872792608886272:12345-192.168.203.56@tcp:4:lfs.0 Request processed in 558us (1076us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1786034584.555559:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 1 00002000:00100000:1.0:1786034584.555567:0:6727:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff964574d17100 x1872792608886272/t4294967302(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:555/0 lens 504/448 e 0 to 0 dl 1786034595 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786034584.555577:0:6727:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574d17100 with x1872792608886272 ext(0->8) 00010000:00010000:1.0:1786034584.555583:0:6727:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 11 pid: 6719 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.555596:0:6727:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 11 pid: 6719 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786034584.555603:0:6727:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff964574d17100 00000100:00100000:2.0:1786034584.565029:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034584.565168:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608886400 00000100:00100000:3.0:1786034584.565181:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608886400 00010000:00010000:3.0:1786034584.565241:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 11 pid: 6719 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034584.565282:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 50 00000100:00100000:3.0:1786034584.565293:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+11:2362:x1872792608886400:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034584.565312:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1786034584.565336:0:5848:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1786034584.565339:0:5848:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1786034583 00002000:00010000:3.0:1786034584.565342:0:5848:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1786034583 00002000:00010000:3.0:1786034584.565345:0:5848:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1786034583 00010000:00010000:3.0:1786034584.565351:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 11 pid: 6719 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.565368:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 11 pid: 6719 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.565407:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011017df/0x490975051af402e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758754 expref: 11 pid: 6719 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.565434:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786034584.565440:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786034584.565447:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000950c883/0x490975051af40321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.565458:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000950c883/0x490975051af40321 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.565504:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034584.565576:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:2362:x1872792608886400:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 283us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034584.565584:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 50 00010000:00010000:2.0:1786034584.566081:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000950c883/0x490975051af40321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034584.566092:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000950c883/0x490975051af40321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034584.566122:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000950c883/0x490975051af40321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034584.566132:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000950c883/0x490975051af40321 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034584.566141:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000950c883/0x490975051af40321 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034584.566149:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:2.0:1786034584.566154:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000950c883/0x490975051af40321 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034584.566164:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000950c883/0x490975051af40321 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034584.566176:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000950c883/0x490975051af40321 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034584.566193:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000950c883/0x490975051af40321 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034584.566265:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2364:x1872792608886144:12345-192.168.203.56@tcp:1:lfs.0 Request processed in 21385us (21618us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034584.566274:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 36 00000100:00100000:2.0:1786034584.568744:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034584.568867:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608886656 00000100:00100000:3.0:1786034584.568876:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608886656 00000100:00100000:3.0:1786034584.568918:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 26 00000100:00100000:3.0:1786034584.568926:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542eef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+38:10532:x1872792608886656:12345-192.168.203.56@tcp:35:lfs.0 00000004:00010000:3.0:1786034584.569006:0:5864:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40313 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758769 expref: 38 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786034584.569347:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1786034584.569392:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1786034584.569771:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1786034584.569846:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.569869:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af402cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758746 expref: 42 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.569879:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.569916:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af402cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758746 expref: 42 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.569931:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af402cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758746 expref: 42 pid: 5861 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034584.569948:0:5864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964547678a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1872792636172288:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034584.570030:0:5864:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a2d5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786034584.581536:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034584.582056:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608886784 00000100:00100000:1.0:1786034584.582067:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608886784 00010000:00010000:1.0:1786034584.582121:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af402cd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758746 expref: 43 pid: 5861 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034584.582200:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 51 00000100:00100000:1.0:1786034584.582212:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+43:2362:x1872792608886784:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034584.582231:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034584.582239:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af402cd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758746 expref: 43 pid: 5861 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.582254:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af402cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758746 expref: 43 pid: 5861 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.582281:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9645521d1e00) 00010000:00010000:1.0:1786034584.582287:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.582298:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.582305:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034584.582328:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034584.582386:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+43:2362:x1872792608886784:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 176us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034584.582394:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 51 00010000:00010000:3.0:1786034584.587289:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af402cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758746 expref: 42 pid: 5861 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034584.587320:0:5864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964547678a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1872792636172288:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034584.587350:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.591272:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.591289:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786034584.592042:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1786034584.592646:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1786034584.593375:0:5864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457dbc5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1872792636172416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786034584.593807:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034584.593941:0:5864:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cda180 going to sleep for 11 seconds 00000100:00100000:3.0:1786034584.596316:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636172416 00000100:00100000:3.0:1786034584.596328:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636172416 00000100:00100000:0.0:1786034584.602920:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786034584.602938:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5864:x1872792636172416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786034584.603290:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5864:x1872792636172416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 355us (9482us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034584.603298:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786034584.608373:0:5864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457dbc5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1872792636172416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1786034584.616113:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1786034584.616231:0:5864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d68700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1872792636172544:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786034584.616321:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034584.616439:0:5864:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d58780 going to sleep for 11 seconds 00000100:00100000:1.0:1786034584.619107:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636172544 00000100:00100000:1.0:1786034584.619118:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636172544 00000100:00100000:1.0:1786034584.619189:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786034584.619198:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5864:x1872792636172544:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1786034584.619455:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5864:x1872792636172544:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 257us (3134us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1786034584.619464:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786034584.619624:0:5864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d68700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1872792636172544:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1786034584.619751:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1786034584.619795:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034584.619806:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034584.619814:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034584.619821:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034584.619886:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034584.619895:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034584.619915:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9645521d1e00) 00010000:00010000:2.0:1786034584.619923:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1786034584.619929:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034584.619936:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40328 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786034584.620118:0:5864:0:(mdd_object.c:4291:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1786034584.620221:0:5864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1786034584.620233:0:5864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 420828409065ns, next at 421828406075ns, rc = 0 00000001:00080000:2.0:1786034584.620239:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1786034584.620267:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9645521d1e00) 00010000:00010000:2.0:1786034584.620270:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786034584.620278:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40313 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758769 expref: 46 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034584.620380:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542eef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+45:10532:x1872792608886656:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 51455us (51643us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1786034584.620389:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 26 00000020:00080000:2.0:1786034584.620393:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1786034584.640651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034584.640692:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608886912 00000100:00100000:0.0:1786034584.640703:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608886912 00000100:00100000:0.0:1786034584.640779:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 100 00000100:00100000:0.0:1786034584.640790:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+45:10532:x1872792608886912:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034584.640818:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034584.640867:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4032f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758770 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.640943:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4032f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758770 expref: 46 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.640960:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4032f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758770 expref: 46 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.640981:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034584.640991:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786034584.640996:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8200, rc 0) 00000100:00100000:0.0:1786034584.641058:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+46:10532:x1872792608886912:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 270us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034584.641065:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 100 00000100:00100000:1.0:1786034584.647510:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034584.648538:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608887168 00000100:00100000:1.0:1786034584.648552:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608887168 00000100:00100000:1.0:1786034584.648621:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 27 00000100:00100000:1.0:1786034584.648633:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+46:10532:x1872792608887168:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:1.0:1786034584.648962:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+47:10532:x1872792608887168:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 330us (1469us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1786034584.648971:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 27 00000001:00080000:3.0:1786034584.683325:0:6746:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1786034584.683345:0:6746:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1786034584.759694:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034584.759886:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608887296 00000100:00100000:3.0:1786034584.759900:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608887296 00000100:00100000:3.0:1786034584.759977:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 101 00000100:00100000:3.0:1786034584.759989:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+47:10542:x1872792608887296:12345-192.168.203.56@tcp:34:lfs.0 00010000:00010000:3.0:1786034584.760104:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40336 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760126:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40336 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760140:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40336 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760158:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4033d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760167:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4033d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760174:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4033d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760310:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af40344 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760320:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af40344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760327:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af40344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786034584.760379:0:6743:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af40344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760394:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40336 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760409:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40336 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760417:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40336 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760424:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034584.760430:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40336 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760438:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40336 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760453:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:3.0:1786034584.760457:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034584.760462:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40336 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760469:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40336 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760485:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4033d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760501:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4033d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760507:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4033d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760513:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034584.760522:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4033d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760529:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4033d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760537:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96454a119f00) 00010000:00010000:3.0:1786034584.760540:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034584.760543:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4033d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760550:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4033d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760564:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af40344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760570:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af40344 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760576:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af40344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760581:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034584.760584:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af40344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760590:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af40344 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760596:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:3.0:1786034584.760598:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034584.760604:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af40344 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034584.760611:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af40344 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034584.760691:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+47:10542:x1872792608887296:12345-192.168.203.56@tcp:34:lfs.0 Request processed in 704us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034584.760698:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 101 00000100:00100000:1.0:1786034584.793817:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034584.794165:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608887552 00000100:00100000:0.0:1786034584.794177:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608887552 00000100:00100000:0.0:1786034584.794265:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 102 00000100:00100000:0.0:1786034584.794277:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+47:10545:x1872792608887552:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034584.794303:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034584.794328:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4034b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758777 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794416:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40352 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794433:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40352 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794449:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40352 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794468:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794475:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794482:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794661:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40360 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794669:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794676:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034584.794687:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1786034584.794869:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40352 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794877:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40352 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794885:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40352 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794891:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034584.794896:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40352 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794904:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40352 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794917:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:0.0:1786034584.794920:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034584.794925:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40352 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794940:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40352 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794955:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794961:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40359 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794966:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794971:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034584.794974:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794981:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40359 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.794989:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff964547ee4700) 00010000:00010000:0.0:1786034584.794991:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034584.794994:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40359 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.795000:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.795052:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4034b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758777 expref: 50 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.795066:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758777 expref: 49 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.795081:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034584.795083:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786034584.795086:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8400, rc 0) 00000100:00100000:0.0:1786034584.795144:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+49:10545:x1872792608887552:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 869us (1340us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1786034584.795152:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 102 00000100:00100000:3.0:1786034584.798382:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034584.799065:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608887680 00000100:00100000:0.0:1786034584.799077:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608887680 00000100:00100000:0.0:1786034584.799142:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 103 00000100:00100000:0.0:1786034584.799152:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964547678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+49:10545:x1872792608887680:12345-192.168.203.56@tcp:54:lfs.0 00010000:00010000:0.0:1786034584.799851:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4036e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.799871:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4036e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.799883:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4036e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.799913:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4036e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.799920:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4036e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.799935:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4036e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.799941:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034584.799963:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4036e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.799970:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4036e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.799984:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034584.799987:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786034584.799993:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4036e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.800000:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4036e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034584.800158:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964547678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+49:10545:x1872792608887680:12345-192.168.203.56@tcp:54:lfs.0 Request processed in 1005us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034584.800167:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 103 00000100:00100000:1.0:1786034584.808931:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034584.810806:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608887936 00000100:00100000:0.0:1786034584.810818:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608887936 00000100:00100000:0.0:1786034584.810954:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 28 00000100:00100000:0.0:1786034584.810966:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+49:10545:x1872792608887936:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:0.0:1786034584.811260:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+50:10545:x1872792608887936:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 296us (2340us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1786034584.811268:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 28 00000100:00100000:2.0:1786034584.948478:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034584.948586:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608888192 00000100:00100000:0.0:1786034584.948598:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608888192 00000100:00100000:0.0:1786034584.948668:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 104 00000100:00100000:0.0:1786034584.948680:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+50:10555:x1872792608888192:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:0.0:1786034584.948709:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034584.948729:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786034584.948764:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af402f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75875b expref: 50 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.948785:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:0.0:1786034584.948790:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786034584.948805:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40375 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75877e expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.948982:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4037c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.948996:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4037c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.949008:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4037c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034584.949020:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1786034584.949169:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af40375 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75877e expref: 52 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.949184:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4037c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75877e expref: 51 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.949192:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034584.949195:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786034584.949198:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9c00, rc 0) 00000100:00100000:0.0:1786034584.949261:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+51:10555:x1872792608888192:12345-192.168.203.56@tcp:101:bash.0 Request processed in 583us (796us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1786034584.949279:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 104 00000100:00100000:3.0:1786034584.956971:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034584.957028:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608888448 00000100:00100000:0.0:1786034584.957040:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608888448 00000100:00100000:0.0:1786034584.957112:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 105 00000100:00100000:0.0:1786034584.957124:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454767aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+51:10555:x1872792608888448:12345-192.168.203.56@tcp:36:bash.0 00010000:00010000:0.0:1786034584.957200:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1786034584.957234:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4037c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75877e expref: 51 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.957260:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40360 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758777 expref: 50 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.957270:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034584.957276:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786034584.957551:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4038a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.957566:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4038a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.957575:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4038a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786034584.957624:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1786034584.957644:0:5862:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000c5e4b213 reply state 0000000052552608 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4038a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034584.957652:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786034584.957778:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454767aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+52:10555:x1872792608888448:12345-192.168.203.56@tcp:36:bash.0 Request processed in 655us (819us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1786034584.957787:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 105 00000020:00080000:0.0:1786034584.957793:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786034584.959133:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4038a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.959144:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4038a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.959151:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4038a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.959159:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034584.959163:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4038a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.959171:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4038a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.959183:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034584.959186:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034584.959192:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4038a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.959198:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4038a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034584.962373:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034584.962448:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608888576 00000100:00100000:0.0:1786034584.962459:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608888576 00000100:00100000:0.0:1786034584.962527:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 106 00000100:00100000:0.0:1786034584.962539:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+51:10555:x1872792608888576:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:0.0:1786034584.962582:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034584.962604:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40391 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758785 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.962710:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40398 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.962725:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.962737:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034584.962771:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1786034584.962776:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034584.962798:0:5861:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.962869:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40391 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758785 expref: 53 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.962885:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40398 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758785 expref: 52 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034584.962893:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034584.962896:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786034584.962899:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8a00, rc 0) 00000100:00100000:0.0:1786034584.962976:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+52:10555:x1872792608888576:12345-192.168.203.56@tcp:101:bash.0 Request processed in 438us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034584.962982:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 106 00000100:00100000:1.0:1786034584.965288:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034584.965373:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608888832 00000100:00100000:2.0:1786034584.965383:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608888832 00000100:00100000:2.0:1786034584.965436:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 29 00000100:00100000:2.0:1786034584.965445:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+52:10555:x1872792608888832:12345-192.168.203.56@tcp:35:bash.0 00000100:00100000:2.0:1786034584.965690:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+53:10555:x1872792608888832:12345-192.168.203.56@tcp:35:bash.0 Request processed in 245us (408us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1786034584.965698:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 29 00000100:00100000:3.0:1786034585.050774:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.050939:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608888960 00000100:00100000:0.0:1786034585.050952:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608888960 00000100:00100000:0.0:1786034585.051052:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 107 00000100:00100000:0.0:1786034585.051064:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+53:10562:x1872792608888960:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034585.051096:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034585.051121:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af4039f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75878c expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.051213:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af403a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.051230:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af403a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.051243:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af403a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034585.051318:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1786034585.051322:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034585.051350:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af403a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.051379:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af4039f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75878c expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.051400:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af403a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75878c expref: 54 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.051409:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:0.0:1786034585.051412:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034585.051434:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8c00, rc 0) 00000100:00080000:3.0:1786034585.051576:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034585.051657:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+54:10562:x1872792608888960:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 595us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034585.051665:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 107 00000100:00100000:3.0:1786034585.063043:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.064136:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608889088 00000100:00100000:0.0:1786034585.064148:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608889088 00000100:00100000:0.0:1786034585.064222:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 108 00000100:00100000:0.0:1786034585.064232:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+54:10562:x1872792608889088:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034585.064257:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034585.064281:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af403ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758793 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064351:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064367:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064378:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064391:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af403bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064398:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af403bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064405:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af403bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064526:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af403c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064549:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af403c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064555:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af403c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034585.064594:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1786034585.064598:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034585.064631:0:5861:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af403c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064642:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af403c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064651:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064657:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064662:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064668:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034585.064672:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064679:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064692:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:0.0:1786034585.064695:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034585.064707:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064714:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064730:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af403bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064737:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af403bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064743:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af403bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064749:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034585.064752:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af403bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064758:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af403bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064766:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff964547ee4700) 00010000:00010000:0.0:1786034585.064768:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034585.064771:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af403bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064776:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af403bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064812:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af403ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758793 expref: 56 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064885:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af403c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758793 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.064892:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034585.064894:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786034585.064897:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9a00, rc 0) 00000100:00100000:0.0:1786034585.064970:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:10562:x1872792608889088:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 739us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034585.064976:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 108 00000100:00100000:1.0:1786034585.067706:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034585.067876:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608889216 00000100:00100000:3.0:1786034585.067888:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608889216 00000100:00100000:3.0:1786034585.067952:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 7 00000100:00100000:3.0:1786034585.067963:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:2363:x1872792608889216:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034585.067982:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034585.068007:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af403c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758793 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.068038:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:3.0:1786034585.068044:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034585.068099:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+54:2363:x1872792608889216:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 138us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034585.068107:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 7 00000100:00100000:2.0:1786034585.070911:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.071114:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608889472 00000100:00100000:0.0:1786034585.071129:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608889472 00000100:00100000:0.0:1786034585.071302:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 109 00000100:00100000:0.0:1786034585.071317:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+54:10562:x1872792608889472:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034585.071346:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034585.071372:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af403c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75879a expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.071507:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.071522:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40398 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758785 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.071530:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.071569:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40398 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758785 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.071598:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40398 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758785 expref: 55 pid: 5861 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034585.071613:0:5862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457dbc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636172672:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034585.071710:0:5862:0:(client.c:2702:ptlrpc_set_wait()) set ffff964549f7a900 going to sleep for 11 seconds 00000100:00100000:2.0:1786034585.075093:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034585.075139:0:5862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457dbc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636172672:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034585.075181:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608889600 00000100:00100000:1.0:1786034585.075188:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608889600 00010000:00010000:1.0:1786034585.075232:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40398 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758785 expref: 56 pid: 5861 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.075238:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034585.075268:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 52 00000100:00100000:1.0:1786034585.075277:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+56:2362:x1872792608889600:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034585.075292:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034585.075298:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40398 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758785 expref: 56 pid: 5861 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.075317:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40398 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758785 expref: 56 pid: 5861 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.075340:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40398 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758785 expref: 56 pid: 5861 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.075355:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:1.0:1786034585.075360:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.075368:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.075374:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.075403:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034585.075424:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.075432:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034585.075450:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1786034585.075633:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af403c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75879a expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.075650:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75879a expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.075657:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:3.0:1786034585.075660:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786034585.075662:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8400, rc 0) 00000100:00100000:1.0:1786034585.081704:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+56:2362:x1872792608889600:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 6411us (6601us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034585.081721:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 52 00000100:00100000:3.0:1786034585.085128:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:10562:x1872792608889472:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 13803us (14218us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1786034585.085141:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 109 00000100:00100000:2.0:1786034585.095413:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034585.097615:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608889856 00000100:00100000:3.0:1786034585.097631:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608889856 00000100:00100000:3.0:1786034585.097894:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 8 00000100:00100000:3.0:1786034585.097906:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e072d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:10562:x1872792608889856:12345-192.168.203.56@tcp:103:lfs.0 00010000:00010000:3.0:1786034585.097927:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034585.097961:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4032f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758770 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.098002:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:3.0:1786034585.098008:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034585.098081:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e072d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+54:10562:x1872792608889856:12345-192.168.203.56@tcp:103:lfs.0 Request processed in 178us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034585.098090:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 8 00000100:00100000:2.0:1786034585.109197:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034585.109306:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608889984 00000100:00100000:1.0:1786034585.109319:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608889984 00000100:00100000:1.0:1786034585.109389:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 110 00000100:00100000:1.0:1786034585.109402:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+54:10562:x1872792608889984:12345-192.168.203.56@tcp:58:lfs.0 00010000:00010000:1.0:1786034585.109565:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af403de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.109588:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af403de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.109610:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af403de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786034585.109901:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1786034585.110018:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+54:10562:x1872792608889984:12345-192.168.203.56@tcp:58:lfs.0 Request processed in 618us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034585.110027:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 110 00000100:00100000:2.0:1786034585.115631:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034585.115817:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608890112 00000100:00100000:3.0:1786034585.115853:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608890112 00000100:00100000:3.0:1786034585.115913:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 111 00000100:00100000:3.0:1786034585.115923:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457470b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+54:10562:x1872792608890112:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034585.115948:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034585.115970:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af403e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7587a1 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.116038:0:6743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af403de lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.116051:0:6743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af403e5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587a1 expref: 55 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.116074:0:6743:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af403de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.116088:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af403e5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587a1 expref: 55 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.116104:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:3.0:1786034585.116114:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786034585.116120:0:6743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af403e5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587a1 expref: 55 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.116129:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0000, rc 0) 00000100:00100000:3.0:1786034585.116205:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457470b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:10562:x1872792608890112:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 282us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034585.116212:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 111 00000004:00080000:1.0:1786034585.136084:0:8042:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 421344256810ns, next at 422344254005ns, rc = 0 00000100:00100000:0.0:1786034585.136254:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636172800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034585.136341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034585.136595:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636173056:0@lo:400:kworker.0 00000100:00100000:3.0:1786034585.136630:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034585.136653:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034585.136658:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636173184:0@lo:400:kworker.0 00000100:00100000:3.0:1786034585.136690:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034585.136731:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636173056 00000100:00100000:3.0:1786034585.136739:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636173056 00000100:00100000:3.0:1786034585.136782:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636173184 00000100:00100000:3.0:1786034585.136784:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636173184 00000100:00080000:3.0:1786034585.136802:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034585.136817:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1786034585.136844:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636173056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034585.136895:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636173056:12345-0@lo:400:kworker.0 Request processed in 71us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034585.136902:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1786034585.136942:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636173056:0@lo:400:kworker.0 00000100:00100000:3.0:1786034585.136974:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1786034585.136980:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636173184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034585.137009:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636173184:12345-0@lo:400:kworker.0 Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034585.137032:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1786034585.137051:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636173184:0@lo:400:kworker.0 00000100:00100000:1.0:1786034585.137165:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636172800 00000100:00100000:1.0:1786034585.137169:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636172800 00000100:00100000:1.0:1786034585.137214:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1786034585.137222:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636172800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786034585.137253:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034585.137286:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636172800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034585.137292:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1786034585.137430:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636173312:0@lo:400:kworker.0 00000100:00100000:0.0:1786034585.137460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034585.137560:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636172928:0@lo:400:kworker.0 00000100:00100000:2.0:1786034585.137596:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034585.137622:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d65bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636173440:0@lo:400:kworker.0 00000100:00100000:2.0:1786034585.137641:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034585.137665:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636172928 00000100:00100000:2.0:1786034585.137677:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636172928 00000100:00100000:2.0:1786034585.137714:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1786034585.137720:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636172928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034585.137749:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636172928:12345-0@lo:400:kworker.0 Request processed in 30us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034585.137755:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000040:00080000:2.0:1786034585.137920:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786034585.137925:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786034585.137987:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1786034585.137993:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786034585.138105:0:11732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457470b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11732:1872792636173568:192.168.203.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786034585.138160:0:11732:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454ac910c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034585.138188:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636172928:0@lo:400:kworker.0 00000100:00100000:2.0:1786034585.138306:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636173440 00000100:00100000:2.0:1786034585.138309:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636173440 00000100:00100000:2.0:1786034585.138333:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1786034585.138345:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636173440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034585.138377:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636173440:12345-0@lo:400:kworker.0 Request processed in 33us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034585.138383:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1786034585.138403:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d65bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636173440:0@lo:400:kworker.0 00000100:00100000:0.0:1786034585.138726:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636172800:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1786034585.138881:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786034585.138885:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786034585.143021:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034585.143128:0:11732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457470b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11732:1872792636173568:192.168.203.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786034585.144020:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608890240 00000100:00100000:0.0:1786034585.144029:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608890240 00000100:00100000:0.0:1786034585.144096:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 112 00000100:00100000:0.0:1786034585.144108:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:10563:x1872792608890240:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786034585.144147:0:5862:0:(mdt_handler.c:8007:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786034585.144283:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:10563:x1872792608890240:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 Request processed in 176us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034585.144290:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 112 00000100:00100000:3.0:1786034585.146244:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.146806:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608890368 00000100:00100000:0.0:1786034585.146815:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608890368 00000100:00100000:0.0:1786034585.146889:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 113 00000100:00100000:0.0:1786034585.146898:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:10563:x1872792608890368:12345-192.168.203.56@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786034585.146977:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af403ec lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.147028:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af403ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.147043:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af403ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034585.149841:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636173312 00000100:00100000:1.0:1786034585.149855:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636173312 00000100:00100000:1.0:1786034585.149937:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1786034585.149948:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636173312:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786034585.150136:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786034585.150363:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636173312:12345-0@lo:400:kworker.0 Request processed in 417us (12900us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034585.150374:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1786034585.150478:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1786034585.150494:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1786034585.150519:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff964574d16d80, transno 4294967301 00000004:00080000:3.0:1786034585.150536:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1786034585.150555:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636173312:0@lo:400:kworker.0 00010000:00010000:0.0:1786034585.151875:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af403f3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.151899:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af403f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.151916:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af403f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.151955:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af403fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.151965:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af403fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.151972:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af403fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034585.152023:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1786034585.152028:0:6743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034585.152046:0:6743:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af403fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152060:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af403ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152087:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af403ec lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152094:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af403ec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152101:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034585.152106:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af403ec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152113:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af403ec lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152128:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9645521d1700) 00010000:00010000:0.0:1786034585.152132:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034585.152136:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af403ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152143:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af403ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152158:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af403f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152163:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af403f3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152169:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af403f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152173:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034585.152287:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af403f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152295:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af403f3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152303:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff964547ee4700) 00010000:00010000:0.0:1786034585.152306:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034585.152309:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af403f3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152315:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af403f3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152332:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af403fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152339:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af403fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152344:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af403fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152349:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034585.152352:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af403fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152358:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af403fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152366:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034585.152369:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034585.152380:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af403fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.152386:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af403fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034585.152478:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:10563:x1872792608890368:12345-192.168.203.56@tcp:34:lhsmtool_posix.0 Request processed in 5577us (6233us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034585.152497:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 113 00000100:00100000:2.0:1786034585.158811:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.161334:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608890624 00000100:00100000:0.0:1786034585.161350:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608890624 00000100:00100000:0.0:1786034585.161430:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 114 00000100:00100000:0.0:1786034585.161443:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:10563:x1872792608890624:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786034585.161470:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034585.161508:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40401 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7587a8 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.161633:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40408 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.161651:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.161665:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034585.170178:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1786034585.170379:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.170394:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40408 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.170419:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40408 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.170426:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034585.170432:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40408 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.170442:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40408 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.170463:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034585.170467:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786034585.170473:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40408 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.170480:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40408 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.170562:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40401 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587a8 expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.170575:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9645521d1700) 00010000:00010000:0.0:1786034585.170577:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786034585.170582:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40401 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587a8 expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.170592:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8e00, rc 0) 00000100:00100000:0.0:1786034585.170678:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+56:10563:x1872792608890624:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 9238us (11881us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1786034585.170697:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 114 00000100:00100000:2.0:1786034585.174402:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034585.174586:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608890752 00000100:00100000:3.0:1786034585.174598:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608890752 00000100:00100000:3.0:1786034585.174657:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 115 00000100:00100000:3.0:1786034585.174667:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+56:10563:x1872792608890752:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786034585.174717:0:5863:0:(mdt_handler.c:8007:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786034585.174845:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+56:10563:x1872792608890752:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 Request processed in 159us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034585.174853:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 115 00000100:00100000:3.0:1786034585.179738:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.179865:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608891008 00000100:00100000:0.0:1786034585.179877:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608891008 00000100:00100000:0.0:1786034585.179938:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 116 00000100:00100000:0.0:1786034585.179949:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+56:10563:x1872792608891008:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786034585.179975:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034585.179979:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786034585.180015:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af403a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75878c expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.180052:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:0.0:1786034585.180058:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786034585.180073:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40416 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7587af expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786034585.180577:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1786034585.182031:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4041d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.182052:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4041d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.182065:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4041d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.182157:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40416 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587af expref: 58 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.182205:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4041d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587af expref: 57 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.182214:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff964547ee4700) 00010000:00010000:0.0:1786034585.182217:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786034585.182221:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9600, rc 0) 00000100:00100000:0.0:1786034585.182305:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+57:10563:x1872792608891008:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 2356us (2578us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1786034585.182314:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 116 00000100:00100000:2.0:1786034585.187061:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034585.187153:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608891264 00000100:00100000:3.0:1786034585.187166:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608891264 00000100:00100000:3.0:1786034585.187242:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 117 00000100:00100000:3.0:1786034585.187254:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+57:10563:x1872792608891264:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786034585.187345:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034585.187378:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4041d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587af expref: 57 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187400:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff964547ee4700) 00010000:00010000:3.0:1786034585.187413:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034585.187436:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4042b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187452:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4042b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187462:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4042b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187478:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40432 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3902c93c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187485:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3902c93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187502:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3902c93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187596:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4042b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187604:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4042b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187611:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4042b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187625:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034585.187630:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4042b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187638:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4042b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187647:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:3.0:1786034585.187650:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034585.187655:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4042b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187661:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4042b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187670:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3902c93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187676:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40432 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3902c93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187683:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40432 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3902c93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187688:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034585.187691:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40432 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3902c93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187696:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40432 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3902c93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187729:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3902c93c (ffff96454a119f00) 00010000:00010000:3.0:1786034585.187731:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034585.187733:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40432 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3902c93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.187739:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40432 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3902c93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034585.187922:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+56:10563:x1872792608891264:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 670us (871us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786034585.187930:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 117 00000100:00100000:2.0:1786034585.195238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034585.199294:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608891392 00000100:00100000:1.0:1786034585.199310:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608891392 00000100:00100000:1.0:1786034585.202575:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 118 00000100:00100000:1.0:1786034585.202598:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457470ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+56:10563:x1872792608891392:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786034585.202643:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034585.202675:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40439 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7587b6 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.202723:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40440 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.202740:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.202753:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.202904:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40439 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587b6 expref: 58 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.202927:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587b6 expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.202936:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9645521d1100) 00010000:00010000:1.0:1786034585.202940:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786034585.202943:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01c00, rc 0) 00000100:00100000:1.0:1786034585.203026:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457470ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+57:10563:x1872792608891392:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 438us (7858us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034585.203034:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 118 00000100:00100000:2.0:1786034585.205626:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.208027:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608891648 00000100:00100000:0.0:1786034585.208041:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608891648 00000100:00100000:2.0:1786034585.208463:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 119 00000100:00100000:2.0:1786034585.208476:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457470aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+57:10563:x1872792608891648:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786034585.208589:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40447 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.208610:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.208623:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786034585.209497:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1786034585.209613:0:5861:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000367d86fd reply state 000000003d97ab4b transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034585.209624:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786034585.210919:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457470aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+59:10563:x1872792608891648:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 2438us (5292us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1786034585.210945:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 119 00000100:00100000:0.0:1786034585.221453:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.221504:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608891776 00000100:00100000:0.0:1786034585.221516:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608891776 00000100:00100000:0.0:1786034585.221577:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 120 00000100:00100000:0.0:1786034585.221589:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+59:10563:x1872792608891776:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786034585.221619:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034585.221646:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4044e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7587bd expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.221735:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4044e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587bd expref: 60 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.221753:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4044e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587bd expref: 60 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.221800:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9645521d1100) 00010000:00010000:0.0:1786034585.221804:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786034585.221808:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8c00, rc 0) 00000100:00100000:0.0:1786034585.221899:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+60:10563:x1872792608891776:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 312us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034585.221907:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 120 00010000:00010000:3.0:1786034585.224675:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.224692:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40447 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.224701:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40447 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.224716:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034585.224721:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40447 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.224730:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40447 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.224749:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9645521d1100) 00010000:00010000:3.0:1786034585.224752:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786034585.224756:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40447 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.224776:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40447 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034585.224959:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034585.225297:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608891904 00000100:00100000:3.0:1786034585.225308:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608891904 00000100:00100000:3.0:1786034585.225379:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 37 00000100:00100000:3.0:1786034585.225388:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2362:x1872792608891904:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1786034585.225784:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786034585.226302:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2362:x1872792608891904:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 Request processed in 913us (1345us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1786034585.226311:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 37 00000100:00100000:2.0:1786034585.228353:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.230283:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608892160 00000100:00100000:0.0:1786034585.230298:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608892160 00000100:00100000:0.0:1786034585.230365:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 30 00000100:00100000:0.0:1786034585.230376:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+59:10563:x1872792608892160:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786034585.230664:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+60:10563:x1872792608892160:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 Request processed in 289us (2317us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1786034585.230773:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 30 00000100:00100000:0.0:1786034585.233455:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034585.235714:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608892416 00000100:00100000:2.0:1786034585.235727:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608892416 00000100:00100000:2.0:1786034585.235804:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 121 00000100:00100000:2.0:1786034585.235815:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+60:10563:x1872792608892416:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786034585.235995:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+60:10563:x1872792608892416:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 181us (2545us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034585.236003:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 121 00000100:00100000:2.0:1786034585.239007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.239136:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608892544 00000100:00100000:0.0:1786034585.239147:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608892544 00000100:00100000:0.0:1786034585.239214:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 122 00000100:00100000:0.0:1786034585.239225:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457470b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+60:10563:x1872792608892544:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786034585.239246:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034585.239272:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40455 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7587c4 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.239353:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af4045c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.239381:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af4045c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.239395:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af4045c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034585.239442:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034585.239464:0:5863:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af4045c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.239504:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40455 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587c4 expref: 62 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.239525:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af4045c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587c4 expref: 61 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.239534:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9645521d1100) 00010000:00010000:0.0:1786034585.239537:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786034585.239541:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9e00, rc 0) 00000100:00100000:0.0:1786034585.239608:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457470b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:10563:x1872792608892544:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 385us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034585.239616:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 122 00000100:00100000:2.0:1786034585.248359:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034585.250903:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608892672 00000100:00100000:1.0:1786034585.250918:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608892672 00000100:00100000:2.0:1786034585.254436:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 38 00000100:00100000:2.0:1786034585.254454:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2363:x1872792608892672:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786034585.254479:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034585.254514:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40463 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7587cb expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786034585.254548:0:6719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a74b998, blocks: 0x1 00010000:00010000:2.0:1786034585.254573:0:6719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1786034585.254579:0:6719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034585.254590:0:6719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40463 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587cb expref: 10 pid: 6719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.254613:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40463 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587cb expref: 10 pid: 6719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.254653:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6e00, rc 0) 00000100:00100000:2.0:1786034585.254753:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:2363:x1872792608892672:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 304us (6409us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034585.254760:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 38 00000100:00100000:0.0:1786034585.258589:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034585.258670:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608892928 00000100:00100000:3.0:1786034585.258681:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608892928 00000100:00100000:3.0:1786034585.258747:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 123 00000100:00100000:3.0:1786034585.258757:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:10563:x1872792608892928:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786034585.258896:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:10563:x1872792608892928:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 140us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034585.258904:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 123 00000100:00100000:0.0:1786034585.261064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034585.266257:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608893056 00000100:00100000:1.0:1786034585.266276:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608893056 00010000:00010000:1.0:1786034585.266412:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034585.268919:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 39 00000100:00100000:0.0:1786034585.268934:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:10563:x1872792608893056:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786034585.268957:0:6720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034585.268994:0:6720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af4046a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7587d2 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.269037:0:6720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40463 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587cb expref: 11 pid: 6719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.269048:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786034585.269053:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786034585.269060:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af4046a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d2 expref: 11 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.269103:0:6720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40463 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587cb expref: 11 pid: 6719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.269119:0:6720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40463 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587cb expref: 11 pid: 6719 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034585.269137:0:6720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6720:1872792636173696:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034585.269428:0:6720:0:(client.c:2702:ptlrpc_set_wait()) set ffff964549f7ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1786034585.275430:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.277346:0:6720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6720:1872792636173696:192.168.203.56@tcp:104: 00010000:00010000:0.0:1786034585.277391:0:6720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af4046a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d2 expref: 11 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.277418:0:6720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9200, rc 0) 00000100:00100000:0.0:1786034585.277495:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+11:10563:x1872792608893056:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 8554us (16425us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034585.277527:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 39 00000100:00100000:1.0:1786034585.280864:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608893184 00000100:00100000:1.0:1786034585.280880:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608893184 00010000:00010000:1.0:1786034585.280947:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40463 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587cb expref: 11 pid: 6719 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034585.280991:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 53 00000100:00100000:1.0:1786034585.281002:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454aceec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+11:2362:x1872792608893184:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034585.281020:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034585.281053:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40463 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587cb expref: 11 pid: 6719 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.281069:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40463 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587cb expref: 11 pid: 6719 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.281099:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40463 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587cb expref: 11 pid: 6719 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.281120:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034585.281125:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034585.281134:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af4046a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d2 expref: 10 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.281144:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af4046a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d2 expref: 10 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.281328:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af4046a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d2 expref: 10 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034585.281360:0:5846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5846:1872792636173824:192.168.203.56@tcp:105: 00000100:00100000:1.0:1786034585.281451:0:5846:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf600 going to sleep for 11 seconds 00000100:00100000:2.0:1786034585.291081:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.292860:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608893312 00000100:00100000:0.0:1786034585.292874:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608893312 00002000:00100000:0.0:1786034585.292943:0:6726:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff964574708380 x1872792608893312/t0(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:556/0 lens 504/0 e 0 to 0 dl 1786034596 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786034585.292955:0:6726:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574708380 with x1872792608893312 ext(0->12) 00002000:00010000:0.0:1786034585.292961:0:6726:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff964574708380 00000100:00100000:0.0:1786034585.292992:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 2 00000100:00100000:0.0:1786034585.293003:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+11:2363:x1872792608893312:12345-192.168.203.56@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1786034585.294360:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:2363:x1872792608893312:12345-192.168.203.56@tcp:4:lhsmtool_posix.0 Request processed in 1354us (3285us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1786034585.294370:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 2 00002000:00100000:0.0:1786034585.294378:0:6726:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff964574708380 x1872792608893312/t4294967308(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:556/0 lens 504/448 e 0 to 0 dl 1786034596 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786034585.294388:0:6726:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574708380 with x1872792608893312 ext(0->12) 00002000:00010000:0.0:1786034585.294392:0:6726:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff964574708380 00000100:00100000:1.0:1786034585.297535:0:5846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5846:1872792636173824:192.168.203.56@tcp:105: 00010000:00010000:1.0:1786034585.297573:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034585.297647:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454aceec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+12:2362:x1872792608893184:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 16646us (22227us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034585.297660:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 53 00000100:00100000:2.0:1786034585.304378:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.307876:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608893440 00000100:00100000:0.0:1786034585.307893:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608893440 00000100:00100000:0.0:1786034585.309014:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 124 00000100:00100000:0.0:1786034585.309030:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457470a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:10563:x1872792608893440:12345-192.168.203.56@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1786034585.446332:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1786034585.446416:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:3.0:1786034585.446464:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1786034585.446484:0:5883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff964558cdf540 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1786034585.446505:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff964580a7ab00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff964558cdf840 00000020:00080000:3.0:1786034585.446509:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff964580a7a800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96457651e800 00000100:00100000:3.0:1786034585.446597:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786034585.446638:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636173952:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1786034585.447411:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1786034585.448091:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034585.448230:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636174080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786034585.448261:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034585.455125:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457470a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:10563:x1872792608893440:12345-192.168.203.56@tcp:44:lhsmtool_posix.0 Request processed in 146089us (150748us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034585.455139:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 124 00000100:00100000:2.0:1786034585.458598:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636173952 00000100:00100000:2.0:1786034585.458614:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636173952 00000100:00100000:2.0:1786034585.458696:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636174080 00000100:00100000:2.0:1786034585.458709:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636174080 00000100:00100000:2.0:1786034585.458747:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786034585.458757:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636173952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786034585.458792:0:6719:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1786034585.458846:0:6719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a74b997, atime: 0x6a74b997, ctime: 0x6a74b997, blocks: 0xb 00010000:00010000:2.0:1786034585.458856:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006079e502/0x490975051af40471 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.458876:0:6719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1786034585.458880:0:6719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034585.458888:0:6719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006079e502/0x490975051af40471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.458904:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006079e502/0x490975051af40471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.459067:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006079e502/0x490975051af40471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.459076:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006079e502/0x490975051af40471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.459096:0:6719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786034585.459937:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786034585.459950:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1872792636174080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786034585.459979:0:8676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1786034585.459997:0:8676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f48860/0x490975051af40478 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.460012:0:8676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003a132bfc/0x490975051af40233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758731 expref: 11 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.460019:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1786034585.460023:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786034585.460026:0:8676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f48860/0x490975051af40478 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.460065:0:8676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003a132bfc/0x490975051af40233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758731 expref: 11 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.460079:0:8676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003a132bfc/0x490975051af40233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758731 expref: 11 pid: 6720 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034585.460112:0:8676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1872792636174208:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034585.460339:0:8676:0:(client.c:2702:ptlrpc_set_wait()) set ffff964559b5bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1786034585.460407:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000004:00080000:1.0:1786034585.462860:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1786034585.462892:0:5883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96455d0a9000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1786034585.462897:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96454ab33b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96455d0a9900 00000020:00080000:1.0:1786034585.462901:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96454ab33f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff964575182c00 00000100:00100000:2.0:1786034585.468519:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1872792636173952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9752us (20418us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1786034585.468534:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786034585.468574:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608893568 00000100:00100000:2.0:1786034585.468583:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608893568 00000100:00100000:2.0:1786034585.468623:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 42 00000100:00100000:2.0:1786034585.468632:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+12:2364:x1872792608893568:12345-192.168.203.56@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1786034585.469014:0:8676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1872792636174208:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034585.469105:0:8676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050f48860/0x490975051af40478 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034585.469894:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034585.469924:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608893696 00000100:00100000:3.0:1786034585.469938:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608893696 00010000:00010000:3.0:1786034585.469966:0:7671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003a132bfc/0x490975051af40233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758731 expref: 13 pid: 6720 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034585.469996:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 54 00000100:00100000:3.0:1786034585.470004:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:2362:x1872792608893696:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034585.470343:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034585.470352:0:7671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003a132bfc/0x490975051af40233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758731 expref: 13 pid: 6720 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.470367:0:7671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003a132bfc/0x490975051af40233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758731 expref: 13 pid: 6720 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.470394:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a132bfc/0x490975051af40233 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758731 expref: 13 pid: 6720 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.470429:0:7671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786034585.470435:0:7671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786034585.470441:0:7671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050f48860/0x490975051af40478 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.470452:0:7671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f48860/0x490975051af40478 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.470491:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034585.470543:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+12:2362:x1872792608893696:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 539us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034585.470551:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 54 00010000:00010000:2.0:1786034585.470884:0:8676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050f48860/0x490975051af40478 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.470894:0:8676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050f48860/0x490975051af40478 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.470905:0:8676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f48860/0x490975051af40478 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.470912:0:8676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050f48860/0x490975051af40478 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.470954:0:8676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1786034585.471697:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff964574d69180/2, rc 0, transno 4294967304 00000100:00100000:1.0:1786034585.471708:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636173952:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786034585.472899:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1872792636174080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12950us (24634us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1786034585.472909:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1786034585.473022:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786034585.473033:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006079e502/0x490975051af40471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.473059:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034585.473064:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006079e502/0x490975051af40471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.473075:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006079e502/0x490975051af40471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.473096:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006079e502/0x490975051af40471 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.473104:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006079e502/0x490975051af40471 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.473128:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034585.473132:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050f48860/0x490975051af40478 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.473138:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0800 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034585.473141:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f48860/0x490975051af40478 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.473149:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f48860/0x490975051af40478 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.473158:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050f48860/0x490975051af40478 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.473173:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050f48860/0x490975051af40478 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.473204:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034585.473206:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034585.473208:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034585.473244:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1786034585.473254:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1786034585.473394:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:1.0:1786034585.479385:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff964548a10380/2, rc 0, transno 4294967309 00000100:00100000:1.0:1786034585.479414:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636174080:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1786034585.620790:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1786034585.620860:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1786034585.621960:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2364:x1872792608893568:12345-192.168.203.56@tcp:16:lhsmtool_posix.0 Request processed in 153321us (161545us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034585.621973:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 42 00000100:00100000:2.0:1786034585.630941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034585.633882:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608893952 00000100:00100000:3.0:1786034585.633898:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608893952 00000100:00100000:2.0:1786034585.636927:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 125 00000100:00100000:2.0:1786034585.636942:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457470a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:10563:x1872792608893952:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786034585.637019:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034585.637056:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af4045c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587c4 expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.637082:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9645521d1100) 00010000:00010000:2.0:1786034585.637088:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786034585.637128:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4047f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.637145:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4047f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.637156:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4047f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786034585.637536:0:5861:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000b52f5620 reply state 00000000e4385c6f transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4047f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034585.637547:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786034585.637797:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457470a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:10563:x1872792608893952:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 858us (6868us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1786034585.637869:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 125 00010000:00010000:1.0:1786034585.643873:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4047f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.643893:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4047f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.643900:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4047f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.643926:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034585.643931:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4047f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.643939:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4047f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.643961:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9645521d1100) 00010000:00010000:1.0:1786034585.643964:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034585.643969:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4047f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.643975:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4047f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034585.644334:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034585.644397:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608894080 00000100:00100000:1.0:1786034585.644408:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608894080 00000100:00100000:1.0:1786034585.644473:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 43 00000100:00100000:1.0:1786034585.644492:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608894080:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1786034585.644817:0:8676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1786034585.644837:0:8676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1786034584 00002000:00010000:1.0:1786034585.644840:0:8676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1786034583 00002000:00010000:1.0:1786034585.644842:0:8676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1786034584 -> 1786034584 00002000:00010000:1.0:1786034585.644844:0:8676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1786034585.649222:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2363:x1872792608894080:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 Request processed in 4723us (4878us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1786034585.649239:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 43 00000100:00100000:3.0:1786034585.658526:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034585.658625:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608894336 00000100:00100000:1.0:1786034585.658655:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608894336 00000100:00100000:1.0:1786034585.658735:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 126 00000100:00100000:1.0:1786034585.658747:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:10563:x1872792608894336:12345-192.168.203.56@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1786034585.658855:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.658875:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40440 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587b6 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.658885:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.658928:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587b6 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.658944:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40440 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587b6 expref: 15 pid: 5862 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034585.658961:0:5862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636174336:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034585.659077:0:5862:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf240 going to sleep for 11 seconds 00000100:00100000:1.0:1786034585.664565:0:5862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636174336:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034585.664608:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034585.664671:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034585.665264:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608894464 00000100:00100000:1.0:1786034585.665273:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608894464 00010000:00010000:1.0:1786034585.665316:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40440 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587b6 expref: 16 pid: 5862 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034585.665381:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 55 00000100:00100000:1.0:1786034585.665392:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:2362:x1872792608894464:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034585.665411:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034585.665419:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40440 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587b6 expref: 16 pid: 5862 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.665432:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587b6 expref: 16 pid: 5862 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.665459:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40440 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587b6 expref: 16 pid: 5862 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.665475:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9645521d1100) 00010000:00010000:1.0:1786034585.665480:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.665500:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.665509:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.665535:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034585.667392:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.667407:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.667447:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.667455:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.667511:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.667518:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034585.667523:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.667531:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.667547:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9645521d1100) 00010000:00010000:3.0:1786034585.667550:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786034585.667553:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.667560:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40486 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034585.672242:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:2362:x1872792608894464:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 6834us (7554us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034585.672260:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 55 00000100:00100000:3.0:1786034585.676543:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:10563:x1872792608894336:12345-192.168.203.56@tcp:55:lhsmtool_posix.0 Request processed in 17782us (18015us total) trans 0 rc -22/-22 00000100:00100000:3.0:1786034585.676560:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 126 00000100:00100000:1.0:1786034585.682109:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.682245:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608894592 00000100:00100000:0.0:1786034585.682258:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608894592 00000100:00100000:0.0:1786034585.682329:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 44 00000100:00100000:0.0:1786034585.682341:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2363:x1872792608894592:12345-192.168.203.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786034585.682397:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af4048d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.682420:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af4046a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d2 expref: 7 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.682430:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786034585.682435:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786034585.682440:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af4048d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.682503:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af4046a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d2 expref: 7 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.682520:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af4046a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d2 expref: 7 pid: 6720 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034585.682537:0:6721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6721:1872792636174464:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034585.682639:0:6721:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d70000 going to sleep for 11 seconds 00000100:00100000:0.0:1786034585.687031:0:6721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6721:1872792636174464:192.168.203.56@tcp:104: 00010000:00010000:0.0:1786034585.687063:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af4048d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034585.687188:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.687357:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608894720 00000100:00100000:0.0:1786034585.687366:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608894720 00010000:00010000:0.0:1786034585.687403:0:7671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af4046a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d2 expref: 8 pid: 6720 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034585.687443:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 56 00000100:00100000:0.0:1786034585.687453:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2363:x1872792608894720:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034585.687472:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034585.687509:0:7671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af4046a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d2 expref: 8 pid: 6720 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.687522:0:7671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af4046a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d2 expref: 8 pid: 6720 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.687567:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af4046a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d2 expref: 8 pid: 6720 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.687584:0:7671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786034585.687589:0:7671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786034585.687595:0:7671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af4048d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.687604:0:7671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af4048d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.687634:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034585.687688:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2363:x1872792608894720:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 236us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034585.687696:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 56 00010000:00010000:2.0:1786034585.688542:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af4048d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.688555:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af4048d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.688589:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af4048d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.688598:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af4048d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.688607:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af4048d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.688614:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:2.0:1786034585.688619:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af4048d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.688628:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af4048d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.688642:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af4048d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.688667:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093d48d3c/0x490975051af4048d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034585.688758:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2363:x1872792608894592:12345-192.168.203.56@tcp:1:lhsmtool_posix.0 Request processed in 6418us (6660us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034585.688768:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 44 00000100:00100000:3.0:1786034585.700349:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.700467:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608894976 00000100:00100000:0.0:1786034585.700480:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608894976 00000100:00100000:0.0:1786034585.700561:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 127 00000100:00100000:0.0:1786034585.700573:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:10563:x1872792608894976:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786034585.700677:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40494 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.700699:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40494 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.700725:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40494 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.701037:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.701050:0:6743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4044e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587bd expref: 15 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.701060:0:6743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.701103:0:6743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4044e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587bd expref: 15 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.701118:0:6743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4044e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587bd expref: 15 pid: 6743 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034585.701134:0:6743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a12680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6743:1872792636174592:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034585.701225:0:6743:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d70000 going to sleep for 11 seconds 00000100:00100000:1.0:1786034585.708575:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034585.708801:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608895104 00000100:00100000:3.0:1786034585.708814:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608895104 00010000:00010000:3.0:1786034585.708906:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4044e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587bd expref: 16 pid: 6743 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034585.708944:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 57 00000100:00100000:3.0:1786034585.708974:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:2363:x1872792608895104:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034585.708993:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034585.709001:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4044e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587bd expref: 16 pid: 6743 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.709026:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4044e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587bd expref: 16 pid: 6743 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.709056:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9645521d1100) 00010000:00010000:3.0:1786034585.709061:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.709070:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.709078:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034585.709100:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034585.709270:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+16:2363:x1872792608895104:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 298us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034585.709278:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 57 00010000:00010000:0.0:1786034585.709535:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af4044e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587bd expref: 15 pid: 6743 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034585.709554:0:6743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a12680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6743:1872792636174592:192.168.203.56@tcp:104: 00010000:00010000:0.0:1786034585.709577:0:6743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.709587:0:6743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.709592:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786034585.709871:0:6743:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1786034585.710221:0:6743:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1786034585.710275:0:6743:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1786034585.710372:0:6743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a12680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6743:1872792636174720:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786034585.710447:0:6743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034585.710531:0:6743:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454133a240 going to sleep for 11 seconds 00000100:00100000:1.0:1786034585.714422:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636174720 00000100:00100000:1.0:1786034585.714442:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636174720 00000100:00100000:0.0:1786034585.714756:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786034585.714767:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6743:x1872792636174720:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786034585.714943:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6743:x1872792636174720:12345-0@lo:1000:mdt00_003.0 Request processed in 177us (4495us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034585.714952:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786034585.715125:0:6743:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1786034585.715134:0:6743:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1786034585.715156:0:6743:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff964548a10380, transno 4294967309 00000100:00100000:1.0:1786034585.715185:0:6743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a12680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6743:1872792636174720:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1786034585.715756:0:6743:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1786034585.715866:0:6743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6743:1872792636174848:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786034585.715908:0:6743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034585.715941:0:6743:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d70000 going to sleep for 11 seconds 00000100:00100000:2.0:1786034585.716101:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636174848 00000100:00100000:2.0:1786034585.716108:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636174848 00000100:00100000:2.0:1786034585.716153:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786034585.716163:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6743:x1872792636174848:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786034585.716371:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6743:x1872792636174848:12345-0@lo:1000:mdt00_003.0 Request processed in 210us (461us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1786034585.716379:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786034585.718890:0:6743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6743:1872792636174848:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1786034585.718950:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.718963:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.718971:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.718979:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034585.718984:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.718993:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.719013:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9645521d1100) 00010000:00010000:1.0:1786034585.719017:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786034585.719034:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.719042:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4049b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.719084:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af403de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.719091:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af403de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.719097:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af403de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.719102:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034585.719106:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af403de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.719112:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af403de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.719121:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:1.0:1786034585.719123:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786034585.719132:0:6743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af403e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587a1 expref: 18 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.719145:0:6743:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af403e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587a1 expref: 18 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034585.719153:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af403e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587a1 expref: 18 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.723396:0:6743:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af403e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587a1 expref: 18 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034585.723427:0:6743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a10380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6743:1872792636174976:192.168.203.56@tcp:105: 00000100:00100000:0.0:1786034585.723591:0:6743:0:(client.c:2702:ptlrpc_set_wait()) set ffff96458093ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1786034585.735522:0:6743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a10380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6743:1872792636174976:192.168.203.56@tcp:105: 00010000:00010000:0.0:1786034585.735563:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af403de lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735577:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af403de lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735620:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735637:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735674:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735687:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735694:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735713:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735721:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034585.735725:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735733:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735747:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034585.735751:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034585.735756:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735762:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735773:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40494 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735779:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40494 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735792:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40494 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735797:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034585.735801:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40494 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735807:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40494 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735817:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034585.735820:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786034585.735860:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40494 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.735868:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40494 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034585.736149:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:10563:x1872792608894976:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 35576us (35811us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1786034585.736160:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 127 00000020:00080000:0.0:1786034585.736167:0:6743:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1786034585.736675:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034585.736754:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608895232 00000100:00100000:2.0:1786034585.736763:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608895232 00000100:00100000:2.0:1786034585.736820:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 31 00000100:00100000:2.0:1786034585.736852:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:10562:x1872792608895232:12345-192.168.203.56@tcp:49:lfs.0 00000100:00100000:2.0:1786034585.736964:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:10562:x1872792608895232:12345-192.168.203.56@tcp:49:lfs.0 Request processed in 115us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034585.736971:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 31 00000040:00080000:3.0:1786034585.737381:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786034585.737386:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786034585.742045:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1786034585.742069:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786034585.748256:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034585.748349:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034585.749384:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608895744 00000100:00100000:2.0:1786034585.749397:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608895744 00000100:00100000:2.0:1786034585.749458:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 32 00000100:00100000:2.0:1786034585.749469:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542eed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:10563:x1872792608895744:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1786034585.750370:0:5864:0:(mdd_object.c:4291:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1786034585.750511:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1786034585.750564:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af404a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.750584:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af404a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.750598:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af404a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.750607:0:5864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af404a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.750613:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af404a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.750620:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af404a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.750645:0:5864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786034585.750754:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542eed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:10563:x1872792608895744:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 Request processed in 1285us (2402us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1786034585.750763:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 32 00000020:00080000:2.0:1786034585.750768:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786034585.750842:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786034585.750850:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af404a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.750857:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6e00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:2.0:1786034585.750862:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af404a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.750876:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af404a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.750892:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96455a530a00) 00010000:00010000:2.0:1786034585.750895:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786034585.750900:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af404a9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.750906:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af404a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.750924:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034585.750926:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034585.750928:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034585.756378:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608895488 00000100:00100000:3.0:1786034585.756397:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608895488 00000100:00100000:2.0:1786034585.756680:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 128 00000100:00100000:2.0:1786034585.756692:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:10562:x1872792608895488:12345-192.168.203.56@tcp:58:lfs.0 00000040:00080000:2.0:1786034585.757042:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1786034585.757140:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:10562:x1872792608895488:12345-192.168.203.56@tcp:58:lfs.0 Request processed in 450us (8896us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034585.757148:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 128 00000100:00100000:1.0:1786034585.794546:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034585.794660:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608895872 00000100:00100000:2.0:1786034585.794672:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608895872 00000100:00100000:2.0:1786034585.794755:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 129 00000100:00100000:2.0:1786034585.794768:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:10565:x1872792608895872:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:2.0:1786034585.794803:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034585.794867:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af404b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7587d9 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.794973:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af404b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.794989:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af404b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.795004:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af404b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.795020:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af404be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.795026:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af404be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.795032:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af404be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.795374:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af404c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.795385:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75879a expref: 21 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.795394:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af404c5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.795433:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75879a expref: 21 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.795459:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75879a expref: 21 pid: 5862 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034585.795475:0:5861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574708700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636175104:192.168.203.56@tcp:104: 00000100:00100000:2.0:1786034585.795579:0:5861:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542db1240 going to sleep for 11 seconds 00000100:00100000:1.0:1786034585.797453:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.797543:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608896128 00000100:00100000:0.0:1786034585.797551:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608896128 00000100:00100000:0.0:1786034585.797599:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 33 00000100:00100000:0.0:1786034585.797607:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+22:5610:x1872792608896128:12345-192.168.203.56@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786034585.797869:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+23:5610:x1872792608896128:12345-192.168.203.56@tcp:35:ldlm_bl.0 Request processed in 262us (419us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1786034585.797888:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 33 00000100:00100000:2.0:1786034585.798965:0:5861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574708700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636175104:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034585.798993:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af404c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034585.799473:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034585.799554:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608896256 00000100:00100000:0.0:1786034585.799561:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608896256 00010000:00010000:0.0:1786034585.799590:0:7671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75879a expref: 23 pid: 5862 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034585.799629:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 58 00000100:00100000:0.0:1786034585.799638:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+23:2362:x1872792608896256:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034585.799655:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034585.799663:0:7671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75879a expref: 23 pid: 5862 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.799675:0:7671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75879a expref: 23 pid: 5862 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.799700:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af403d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75879a expref: 23 pid: 5862 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.799727:0:7671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034585.799733:0:7671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af404c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.799743:0:7671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af404c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.799750:0:7671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af404c5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034585.799794:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034585.799872:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+22:2362:x1872792608896256:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 235us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034585.799880:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 58 00010000:00010000:2.0:1786034585.800524:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af404c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800533:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af404c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034585.800582:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1786034585.800586:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786034585.800608:0:5861:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af404c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800621:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af404c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800633:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af404b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800639:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af404b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800657:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af404b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800663:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034585.800668:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af404b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800676:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af404b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800687:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:2.0:1786034585.800690:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034585.800694:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af404b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800714:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af404b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800727:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af404be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800733:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af404be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800739:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af404be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800743:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034585.800746:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af404be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800763:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af404be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800772:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96455a530a00) 00010000:00010000:2.0:1786034585.800775:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034585.800778:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af404be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800783:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af404be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800819:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af404b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d9 expref: 22 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800866:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af404c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d9 expref: 21 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034585.800873:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:2.0:1786034585.800875:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786034585.800878:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7200, rc 0) 00000100:00100000:2.0:1786034585.800966:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:10565:x1872792608895872:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 6201us (6434us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034585.800973:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 129 00010000:00010000:0.0:1786034586.289185:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786034586.800555:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786034586.800569:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786034586.800625:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1786034586.800632:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786034586.801462:0:11732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455185b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11732:1872792636175232:192.168.203.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786034586.801587:0:11732:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cec600 going to sleep for 11 seconds 00000100:00100000:3.0:1786034586.813981:0:11732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455185b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11732:1872792636175232:192.168.203.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786034586.823618:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034586.823655:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608896384 00000100:00100000:3.0:1786034586.823665:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608896384 00000100:00100000:3.0:1786034586.823715:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 130 00000100:00100000:3.0:1786034586.823725:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:10576:x1872792608896384:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786034586.823758:0:5863:0:(mdt_handler.c:8007:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786034586.823871:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:10576:x1872792608896384:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 Request processed in 147us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034586.823879:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 130 00000100:00100000:0.0:1786034586.847892:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034586.847966:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608896640 00000100:00100000:1.0:1786034586.847975:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608896640 00000100:00100000:1.0:1786034586.848031:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 131 00000100:00100000:1.0:1786034586.848040:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:10576:x1872792608896640:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786034586.848058:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034586.848076:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af404cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7587e0 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034586.848175:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af404d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034586.848189:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af404d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034586.848202:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af404d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034586.848212:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1786034586.848337:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af404cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587e0 expref: 24 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034586.848352:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af404d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587e0 expref: 23 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034586.848367:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:1.0:1786034586.848370:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034586.848374:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00a00, rc 0) 00000100:00100000:1.0:1786034586.848428:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+23:10576:x1872792608896640:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 388us (543us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1786034586.848434:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 131 00000100:00100000:3.0:1786034586.857799:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034586.859248:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608896896 00000100:00100000:0.0:1786034586.859257:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608896896 00000100:00100000:0.0:1786034586.859403:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 132 00000100:00100000:0.0:1786034586.859413:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+23:10576:x1872792608896896:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786034586.859491:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034586.859507:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034586.859517:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034586.859676:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034586.859684:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034586.859690:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034586.860773:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034586.860785:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034586.860793:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034586.860805:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034586.860809:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786034586.860813:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034586.860818:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af404e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034586.860976:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:10576:x1872792608896896:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 1560us (3180us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1786034586.860984:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 132 00000040:00080000:2.0:1786034586.861513:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786034586.861518:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786034586.864072:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1786034586.864086:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786034586.869097:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034586.869179:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034586.869205:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608897280 00000100:00100000:1.0:1786034586.869214:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608897280 00000100:00100000:1.0:1786034586.869258:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 34 00000100:00100000:1.0:1786034586.869279:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:10576:x1872792608897280:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786034586.869503:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+25:10576:x1872792608897280:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 Request processed in 236us (413us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1786034586.869509:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 34 00000100:00100000:1.0:1786034586.869531:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608897024 00000100:00100000:1.0:1786034586.869535:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608897024 00000100:00100000:1.0:1786034586.869564:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00100000:1.0:1786034586.869569:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+25:2362:x1872792608897024:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034586.869579:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034586.869602:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af404d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587e0 expref: 25 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034586.869616:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:1.0:1786034586.869627:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034586.869645:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:2362:x1872792608897024:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 76us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034586.869652:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 9 00000040:00080000:3.0:1786034586.962054:0:12094:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786034586.962064:0:12094:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786034586.962103:0:12094:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1786034586.962108:0:12094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786034587.204798:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034587.207746:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608897536 00000100:00100000:1.0:1786034587.207759:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608897536 00000100:00100000:1.0:1786034587.207887:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 133 00000100:00100000:1.0:1786034587.207899:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:10589:x1872792608897536:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:1.0:1786034587.207920:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034587.207941:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af404e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7587e7 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034587.209507:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af404ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034587.209523:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af404ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034587.209534:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af404ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034587.209545:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1786034587.209673:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af404e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587e7 expref: 27 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034587.209689:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af404ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587e7 expref: 26 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034587.209697:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:1.0:1786034587.209705:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1786034587.209709:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00e00, rc 0) 00000100:00100000:1.0:1786034587.209766:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:10589:x1872792608897536:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 1870us (4976us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1786034587.209773:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 133 00000100:00080000:0.0:1786034587.210047:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034587.212981:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034587.213298:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608897664 00000100:00100000:0.0:1786034587.213307:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608897664 00000100:00100000:0.0:1786034587.213356:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 134 00000100:00100000:0.0:1786034587.213365:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:10589:x1872792608897664:12345-192.168.203.56@tcp:54:lfs.0 00010000:00010000:0.0:1786034587.213419:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af404fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034587.213434:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af404fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034587.213444:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af404fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034587.213486:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af404fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034587.213493:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af404fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034587.213500:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af404fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034587.213506:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034587.213510:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af404fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034587.213517:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af404fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034587.213527:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:0.0:1786034587.213530:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786034587.213534:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af404fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034587.213540:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af404fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034587.213602:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:10589:x1872792608897664:12345-192.168.203.56@tcp:54:lfs.0 Request processed in 238us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034587.213609:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 134 00010000:00010000:0.0:1786034587.313503:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034587.348232:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034587.349863:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608897792 00000100:00100000:0.0:1786034587.349873:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608897792 00000100:00100000:0.0:1786034587.349954:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 45 00000100:00100000:0.0:1786034587.349965:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608897792:12345-192.168.203.56@tcp:101:cat.0 00010000:00010000:0.0:1786034587.349981:0:6720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034587.350000:0:6720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b367a834/0x490975051af40504 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7587ee expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786034587.350027:0:6720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a74b998, atime: 0x6a74b997, ctime: 0x6a74b998, blocks: 0xb 00010000:00010000:0.0:1786034587.350045:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=423s v=(0 0) 00010000:00010000:0.0:1786034587.350050:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786034587.350059:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b367a834/0x490975051af40504 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587ee expref: 7 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034587.350078:0:6720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b367a834/0x490975051af40504 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587ee expref: 7 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034587.350092:0:6720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9a00, rc 0) 00000100:00100000:0.0:1786034587.350146:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2363:x1872792608897792:12345-192.168.203.56@tcp:101:cat.0 Request processed in 184us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034587.350154:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 45 00000100:00080000:3.0:1786034587.350591:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786034587.366348:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034587.366440:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608897920 00000100:00100000:2.0:1786034587.366462:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608897920 00002000:00100000:2.0:1786034587.366520:0:6725:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff96457471d880 x1872792608897920/t0(0) o3->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:558/0 lens 488/0 e 0 to 0 dl 1786034598 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786034587.366530:0:6725:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96457471d880 with x1872792608897920 ext(0->4095) 00002000:00010000:2.0:1786034587.366535:0:6725:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96457471d880 00000100:00100000:2.0:1786034587.366568:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 3 00000100:00100000:2.0:1786034587.366577:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2362:x1872792608897920:12345-192.168.203.56@tcp:3:cat.0 00000100:00100000:2.0:1786034587.366927:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2362:x1872792608897920:12345-192.168.203.56@tcp:3:cat.0 Request processed in 350us (585us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786034587.366934:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 3 00002000:00100000:2.0:1786034587.366941:0:6725:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff96457471d880 x1872792608897920/t0(0) o3->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:558/0 lens 488/4536 e 0 to 0 dl 1786034598 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786034587.366948:0:6725:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96457471d880 with x1872792608897920 ext(0->4095) 00002000:00010000:2.0:1786034587.366952:0:6725:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff96457471d880 00000100:00100000:1.0:1786034587.514077:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034587.514346:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034587.514388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034587.514495:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608898048 00000100:00100000:3.0:1786034587.514503:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608898048 00000100:00100000:3.0:1786034587.514553:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 308 00000100:00100000:3.0:1786034587.514562:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608898048:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034587.514621:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608898048:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 61us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034587.514639:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 308 00000100:00100000:0.0:1786034587.515657:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608898304 00000100:00100000:0.0:1786034587.515663:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608898304 00000100:00100000:0.0:1786034587.515721:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 181 00000100:00100000:0.0:1786034587.515729:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2362:x1872792608898304:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034587.515768:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2362:x1872792608898304:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 40us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034587.515776:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 181 00000100:00080000:3.0:1786034587.515841:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034587.519048:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608898176 00000100:00100000:2.0:1786034587.519059:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608898176 00000100:00100000:2.0:1786034587.519144:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 78 00000100:00100000:2.0:1786034587.519155:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608898176:12345-192.168.203.56@tcp:400:kworker.0 00000100:00080000:3.0:1786034587.519254:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786034587.519468:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608898176:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 314us (5488us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034587.520878:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 78 00000100:00100000:3.0:1786034588.208402:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636175360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786034588.208491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034588.208699:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636175360 00000100:00100000:1.0:1786034588.208707:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636175360 00000100:00100000:1.0:1786034588.208777:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1786034588.208789:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636175360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786034588.208820:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034588.208882:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636175360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034588.208889:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1786034588.209140:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786034588.209185:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636175360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786034588.336206:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034589.366504:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786034589.843395:0:6746:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000004:00080000:1.0:1786034590.256155:0:8042:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 426464327902ns, next at 427464325262ns, rc = 0 00000100:00100000:2.0:1786034590.256237:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457471e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636175488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034590.256315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034590.256581:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636176000:0@lo:400:kworker.0 00000100:00100000:2.0:1786034590.256625:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034590.256649:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786034590.256654:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457470b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636175872:0@lo:400:kworker.0 00000100:00100000:2.0:1786034590.256686:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034590.256815:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457470bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636175744:0@lo:400:kworker.0 00000100:00100000:1.0:1786034590.256869:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034590.256887:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1786034590.256892:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636175616:0@lo:400:kworker.0 00000100:00100000:1.0:1786034590.256920:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034590.256940:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636176128:0@lo:400:kworker.0 00000100:00100000:1.0:1786034590.256967:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034590.256992:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636175616 00000100:00100000:1.0:1786034590.256999:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636175616 00000100:00100000:1.0:1786034590.257046:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1786034590.257055:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636175616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034590.257101:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636175616:12345-0@lo:400:kworker.0 Request processed in 47us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034590.257108:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1786034590.257150:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636175616:0@lo:400:kworker.0 00000100:00100000:2.0:1786034590.257217:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636175872 00000100:00100000:2.0:1786034590.257221:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636175872 00000100:00100000:2.0:1786034590.257262:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636175744 00000100:00100000:2.0:1786034590.257264:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636175744 00000100:00100000:2.0:1786034590.257276:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636176128 00000100:00100000:2.0:1786034590.257278:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636176128 00000100:00100000:2.0:1786034590.257291:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1786034590.257296:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636175872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034590.257331:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636175872:12345-0@lo:400:kworker.0 Request processed in 35us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034590.257337:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1786034590.257347:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1786034590.257352:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636175744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034590.257373:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636175744:12345-0@lo:400:kworker.0 Request processed in 21us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034590.257379:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1786034590.257388:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1786034590.257393:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636176128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034590.257413:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636176128:12345-0@lo:400:kworker.0 Request processed in 20us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034590.257418:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1786034590.257439:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457470b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636175872:0@lo:400:kworker.0 00000100:00080000:1.0:1786034590.257508:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034590.257531:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636176128:0@lo:400:kworker.0 00000100:00100000:1.0:1786034590.257539:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457470bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636175744:0@lo:400:kworker.0 00000100:00100000:0.0:1786034590.257703:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636175488 00000100:00100000:0.0:1786034590.257708:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636175488 00000100:00100000:0.0:1786034590.257754:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1786034590.257761:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1872792636175488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786034590.257790:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034590.257849:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1872792636175488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034590.257856:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1786034590.257875:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636176000 00000100:00100000:0.0:1786034590.257877:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636176000 00000100:00100000:0.0:1786034590.257901:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1786034590.257907:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636176000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034590.257932:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636176000:12345-0@lo:400:kworker.0 Request processed in 26us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034590.257938:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1786034590.258043:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1786034590.258049:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff964574d69180, transno 4294967304 00000100:00100000:3.0:1786034590.258068:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636176000:0@lo:400:kworker.0 00000100:00100000:3.0:1786034590.258083:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457471e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636175488:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1786034590.258157:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034590.258160:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786034590.384066:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786034590.864311:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:1.0:1786034590.864344:0:5883:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000004:00080000:1.0:1786034590.864360:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:1.0:1786034590.864371:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1786034590.864383:0:5883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff964558cdf3c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1786034590.864388:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96454ad0f800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff964558cdf240 00000020:00080000:1.0:1786034590.864392:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96454ad0fd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96457dbcc000 00000020:00080000:1.0:1786034590.864418:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1786034590.864638:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1786034590.864727:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457471fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636176256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786034590.864803:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034590.864918:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636176256 00000100:00100000:1.0:1786034590.864926:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636176256 00000100:00100000:1.0:1786034590.864974:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1786034590.864983:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1872792636176256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786034590.865178:0:6719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1786034590.865182:0:6719:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1786034584 -> 1786034584 00002000:00010000:1.0:1786034590.865185:0:6719:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1786034583 -> 1786034583 00002000:00010000:1.0:1786034590.865188:0:6719:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1786034584 -> 1786034584 00002000:00010000:1.0:1786034590.865190:0:6719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1786034590.865228:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1872792636176256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 246us (425us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1786034590.865236:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:1.0:1786034590.865279:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96457471fb80/2, rc 0, transno 4294967312 00000100:00100000:1.0:1786034590.865284:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457471fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636176256:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1786034590.868083:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1786034590.868104:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000040:00080000:3.0:1786034590.960058:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786034590.960068:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786034590.960107:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1786034590.960113:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786034591.411807:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034592.432401:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034592.623734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034592.623777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034592.623806:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034592.623844:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034592.623870:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034592.623897:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608898816 00000100:00100000:2.0:1786034592.623906:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608898816 00000100:00100000:2.0:1786034592.623955:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608898688 00000100:00100000:2.0:1786034592.623958:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608898688 00000100:00100000:2.0:1786034592.623980:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 80 00000100:00100000:2.0:1786034592.623988:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608898816:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034592.624053:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608898816:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 65us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034592.624061:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 80 00000100:00100000:2.0:1786034592.624077:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 81 00000100:00100000:2.0:1786034592.624083:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2363:x1872792608898688:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034592.624104:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2363:x1872792608898688:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 22us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034592.624109:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 81 00000100:00100000:2.0:1786034592.624123:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608898432 00000100:00100000:2.0:1786034592.624126:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608898432 00000100:00100000:2.0:1786034592.624146:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 310 00000100:00100000:2.0:1786034592.624151:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608898432:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034592.624171:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608898432:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 21us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034592.624287:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 310 00000100:00100000:2.0:1786034592.624432:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608898560 00000100:00100000:2.0:1786034592.624444:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608898560 00000100:00100000:2.0:1786034592.624470:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608898944 00000100:00100000:2.0:1786034592.624473:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608898944 00000100:00100000:2.0:1786034592.624495:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 185 00000100:00100000:2.0:1786034592.624502:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:2363:x1872792608898560:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034592.624532:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:2363:x1872792608898560:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 31us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034592.624538:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 185 00000100:00100000:2.0:1786034592.624550:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 186 00000100:00100000:2.0:1786034592.624556:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608898944:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034592.624577:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608898944:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 22us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034592.624584:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 186 00000100:00080000:2.0:1786034592.624599:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786034592.624603:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786034592.624605:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786034593.329260:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636176384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786034593.329327:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034593.329728:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636176384 00000100:00100000:0.0:1786034593.329736:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636176384 00000100:00100000:0.0:1786034593.329802:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1786034593.329812:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636176384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034593.329865:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034593.329910:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636176384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034593.329917:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1786034593.330017:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636176384:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786034593.330141:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786034593.457878:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034594.298679:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034594.298819:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608899072 00000100:00100000:2.0:1786034594.298854:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608899072 00000100:00100000:2.0:1786034594.298933:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 135 00000100:00100000:2.0:1786034594.298946:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:10250:x1872792608899072:12345-192.168.203.56@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1786034594.299058:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:10250:x1872792608899072:12345-192.168.203.56@tcp:60:lhsmtool_posix.0 Request processed in 116us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034594.299080:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 135 00000100:00080000:1.0:1786034594.299240:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034594.327441:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034594.327672:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608899328 00000100:00100000:1.0:1786034594.327682:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608899328 00000100:00100000:1.0:1786034594.327733:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 35 00000100:00100000:1.0:1786034594.327743:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:10250:x1872792608899328:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786034594.329960:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:10250:x1872792608899328:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 Request processed in 2212us (2530us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1786034594.329970:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 35 00010000:00010000:0.0:1786034594.480491:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034595.311049:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034595.311152:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608899456 00000100:00100000:2.0:1786034595.311162:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608899456 00000100:00100000:2.0:1786034595.311240:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 136 00000100:00100000:2.0:1786034595.311251:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:11041:x1872792608899456:12345-192.168.203.56@tcp:101:lsof.0 00010000:00010000:2.0:1786034595.311271:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034595.311291:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af4050b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7587f5 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034595.311356:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40512 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034595.311370:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034595.311382:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034595.311595:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1786034595.311599:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000100:00080000:1.0:1786034595.311721:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1786034595.312029:0:5861:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40512 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034595.312056:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af4050b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587f5 expref: 7 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034595.312074:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40512 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587f5 expref: 6 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034595.312094:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119600) 00010000:00010000:2.0:1786034595.312097:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786034595.312101:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6e00, rc 0) 00000100:00100000:2.0:1786034595.312159:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:11041:x1872792608899456:12345-192.168.203.56@tcp:101:lsof.0 Request processed in 910us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034595.312166:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 136 00000100:00100000:3.0:1786034595.378998:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636176640:0@lo:400:kworker.0 00000100:00100000:3.0:1786034595.379066:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034595.379121:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636177152:0@lo:400:kworker.0 00000100:00100000:3.0:1786034595.379144:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034595.379184:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034595.379190:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636176768:0@lo:400:kworker.0 00000100:00100000:3.0:1786034595.379210:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034595.379238:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636177152 00000100:00100000:3.0:1786034595.379244:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636177152 00000100:00100000:3.0:1786034595.379291:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1786034595.379300:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636177152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034595.379342:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636177152:12345-0@lo:400:kworker.0 Request processed in 44us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034595.379349:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1786034595.379381:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1786034595.379386:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:3.0:1786034595.379411:0:3309:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff96457471fb80 x1872792636176256/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786034606 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034595.379432:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636177152:0@lo:400:kworker.0 00000100:00100000:3.0:1786034595.379452:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636176640 00000100:00100000:3.0:1786034595.379455:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636176640 00000100:00100000:3.0:1786034595.379476:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636176768 00000100:00100000:3.0:1786034595.379479:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636176768 00000100:00100000:3.0:1786034595.379497:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1786034595.379504:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636176640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034595.379539:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636176640:12345-0@lo:400:kworker.0 Request processed in 36us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034595.379544:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1786034595.379555:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1786034595.379561:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636176768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034595.379597:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636176768:12345-0@lo:400:kworker.0 Request processed in 36us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034595.379608:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1786034595.379634:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636176768:0@lo:400:kworker.0 00000100:00100000:3.0:1786034595.379643:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636176640:0@lo:400:kworker.0 00000100:00100000:2.0:1786034595.379752:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636176896:0@lo:400:kworker.0 00000100:00100000:2.0:1786034595.379780:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034595.379810:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786034595.379815:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636176512:0@lo:400:kworker.0 00000100:00100000:2.0:1786034595.379858:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034595.379876:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636177024:0@lo:400:kworker.0 00000100:00100000:2.0:1786034595.379896:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034595.379917:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636177024 00000100:00100000:2.0:1786034595.379921:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636177024 00000100:00100000:2.0:1786034595.379948:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1786034595.379954:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636177024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034595.379987:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636177024:12345-0@lo:400:kworker.0 Request processed in 32us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034595.379993:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1786034595.380017:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636177024:0@lo:400:kworker.0 00000100:00080000:1.0:1786034595.380119:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786034595.380124:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786034595.380173:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457471f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636177280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034595.380199:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034595.380276:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636177280 00000100:00100000:1.0:1786034595.380279:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636177280 00000100:00100000:1.0:1786034595.380312:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1786034595.380318:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1872792636177280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786034595.380342:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034595.380377:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1872792636177280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034595.380383:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1786034595.380410:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457471f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636177280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034595.380562:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636176896 00000100:00100000:3.0:1786034595.380566:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636176896 00000100:00100000:3.0:1786034595.380611:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1786034595.380617:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636176896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034595.380661:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636176896:12345-0@lo:400:kworker.0 Request processed in 44us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034595.380667:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1786034595.380684:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636176512 00000100:00100000:3.0:1786034595.380687:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636176512 00000100:00100000:3.0:1786034595.380710:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1786034595.380716:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636176512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034595.380743:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636176512:12345-0@lo:400:kworker.0 Request processed in 28us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034595.380750:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1786034595.380913:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636176512:0@lo:400:kworker.0 00000100:00100000:0.0:1786034595.380926:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636176896:0@lo:400:kworker.0 00000100:00080000:1.0:1786034595.380976:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786034595.508977:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786034595.984261:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1786034595.990799:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1786034595.990816:0:5883:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1786034595.990983:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1786034595.990997:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1786034596.531474:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034597.552003:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034597.725971:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034597.726009:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034597.726043:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034597.726070:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034597.726097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034597.726124:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608899968 00000100:00100000:3.0:1786034597.726132:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608899968 00000100:00100000:3.0:1786034597.726196:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608899840 00000100:00100000:3.0:1786034597.726199:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608899840 00000100:00100000:3.0:1786034597.726240:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 84 00000100:00100000:3.0:1786034597.726250:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608899968:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034597.726320:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608899968:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 71us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034597.726328:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 84 00000100:00100000:3.0:1786034597.726343:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 85 00000100:00100000:3.0:1786034597.726360:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608899840:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034597.726384:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608899840:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 36us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034597.726390:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 85 00000100:00100000:3.0:1786034597.726426:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608899712 00000100:00100000:1.0:1786034597.726426:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608899584 00000100:00100000:3.0:1786034597.726433:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608899712 00000100:00100000:1.0:1786034597.726433:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608899584 00000100:00100000:3.0:1786034597.726466:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608900096 00000100:00100000:3.0:1786034597.726469:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608900096 00000100:00100000:1.0:1786034597.726482:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 312 00000100:00100000:1.0:1786034597.726493:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608899584:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034597.726498:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 190 00000100:00100000:3.0:1786034597.726508:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:2362:x1872792608899712:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034597.726531:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608899584:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 39us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034597.726538:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 312 00000100:00100000:3.0:1786034597.726546:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:2362:x1872792608899712:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 38us (580us total) trans 0 rc 0/0 00000100:00080000:1.0:1786034597.726679:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786034597.726683:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034597.726685:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786034597.726704:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 191 00000100:00100000:1.0:1786034597.726712:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2362:x1872792608900096:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034597.726751:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2362:x1872792608900096:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 40us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034597.726759:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 191 00000100:00100000:3.0:1786034597.727243:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 190 00000100:00100000:3.0:1786034598.449224:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786034598.449247:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964548a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636177408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786034598.449325:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034598.449481:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636177408 00000100:00100000:0.0:1786034598.449489:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636177408 00000100:00100000:0.0:1786034598.449561:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1786034598.449571:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636177408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034598.449604:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034598.449653:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636177408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034598.449660:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1786034598.449703:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964548a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636177408:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786034598.449764:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786034598.576033:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034599.600065:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786034600.176090:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786034600.176099:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786034600.176619:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1786034600.176626:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786034600.497595:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786034600.497624:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457471f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636177536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786034600.497710:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034600.497795:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636177536 00000100:00100000:1.0:1786034600.497804:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636177536 00000100:00100000:1.0:1786034600.497888:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1786034600.497901:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636177536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786034600.497948:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034600.497999:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636177536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034600.498007:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1786034600.498029:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786034600.498058:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1786034600.498064:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96457471fb80, transno 4294967312 00000100:00100000:1.0:1786034600.498084:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457471f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636177536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034600.502902:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457471fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636177664:0@lo:400:kworker.0 00000100:00100000:3.0:1786034600.502988:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034600.503079:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636177664 00000100:00100000:0.0:1786034600.503088:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636177664 00000100:00100000:0.0:1786034600.503146:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1786034600.503156:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636177664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034600.505750:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3309:x1872792636177664:12345-0@lo:400:kworker.0 Request processed in 2585us (2751us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034600.505766:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1786034600.505884:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457471f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636177792:0@lo:400:kworker.0 00000100:00100000:0.0:1786034600.505941:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034600.506007:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636177792 00000100:00100000:0.0:1786034600.506017:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636177792 00000100:00100000:0.0:1786034600.506060:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1786034600.506069:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636177792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034600.506138:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636177792:12345-0@lo:400:kworker.0 Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034600.506145:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1786034600.506191:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457471f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636177792:0@lo:400:kworker.0 00000100:00100000:0.0:1786034600.515881:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457471ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636177920:0@lo:400:kworker.0 00000100:00100000:0.0:1786034600.515972:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034600.516017:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786034600.516023:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457471ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636178048:0@lo:400:kworker.0 00000100:00100000:0.0:1786034600.516048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034600.516094:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636178048 00000100:00100000:0.0:1786034600.516102:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636178048 00000100:00100000:0.0:1786034600.516171:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1786034600.516180:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636178048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034600.516236:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636178048:12345-0@lo:400:kworker.0 Request processed in 56us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034600.516244:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1786034600.516267:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786034600.516282:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786034600.516290:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457471df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636178176:0@lo:400:kworker.0 00000100:00100000:0.0:1786034600.516329:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034600.516357:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636177920 00000100:00100000:0.0:1786034600.516360:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636177920 00000100:00100000:0.0:1786034600.516401:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636178176 00000100:00100000:0.0:1786034600.516412:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636178176 00000100:00100000:0.0:1786034600.516439:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1786034600.516445:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636177920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034600.516475:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636177920:12345-0@lo:400:kworker.0 Request processed in 31us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034600.516481:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1786034600.516493:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1786034600.516499:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636178176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034600.516524:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636178176:12345-0@lo:400:kworker.0 Request processed in 25us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034600.516530:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:0.0:1786034600.516545:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034600.516576:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457471ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636178048:0@lo:400:kworker.0 00000100:00100000:0.0:1786034600.516587:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457471ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636177920:0@lo:400:kworker.0 00000100:00100000:0.0:1786034600.516628:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457471df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636178176:0@lo:400:kworker.0 00000100:00100000:3.0:1786034600.519357:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457471fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636177664:0@lo:400:kworker.0 00010000:00010000:0.0:1786034600.627176:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786034601.489731:0:12298:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:43:18 (1786034598) 00010000:00010000:2.0:1786034601.654462:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034602.674892:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034602.846571:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034602.846616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034602.846654:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034602.846678:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034602.846701:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034602.846730:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608900224 00000100:00100000:2.0:1786034602.846741:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608900224 00000100:00100000:2.0:1786034602.846793:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 314 00000100:00100000:2.0:1786034602.846802:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2365:x1872792608900224:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034602.846913:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2365:x1872792608900224:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 111us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034602.846921:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 314 00000100:00100000:0.0:1786034602.847176:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608900352 00000100:00100000:0.0:1786034602.847180:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608900352 00000100:00100000:0.0:1786034602.847231:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608900736 00000100:00100000:0.0:1786034602.847235:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608900736 00000100:00100000:0.0:1786034602.847258:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 195 00000100:00100000:0.0:1786034602.847266:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:2365:x1872792608900352:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034602.847303:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:2365:x1872792608900352:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 38us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034602.847310:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 195 00000100:00100000:0.0:1786034602.847338:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 196 00000100:00100000:0.0:1786034602.847344:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2365:x1872792608900736:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034602.847379:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2365:x1872792608900736:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 34us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034602.847386:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 196 00000100:00100000:0.0:1786034602.847403:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608900608 00000100:00100000:0.0:1786034602.847407:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608900608 00000100:00100000:0.0:1786034602.847430:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608900480 00000100:00100000:0.0:1786034602.847433:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608900480 00000100:00100000:0.0:1786034602.847450:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 87 00000100:00100000:0.0:1786034602.847456:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2365:x1872792608900608:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034602.847479:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2365:x1872792608900608:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 23us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034602.847486:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 87 00000100:00100000:0.0:1786034602.847496:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 88 00000100:00100000:0.0:1786034602.847501:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2365:x1872792608900480:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034602.847520:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2365:x1872792608900480:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 19us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034602.847527:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 88 00000100:00080000:1.0:1786034602.847600:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034602.847605:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786034602.847608:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034603.377219:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034603.377403:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608900992 00000100:00100000:0.0:1786034603.377414:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608900992 00000100:00100000:0.0:1786034603.377489:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 137 00000100:00100000:0.0:1786034603.377500:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:11306:x1872792608900992:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786034603.377525:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034603.377550:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40519 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7587fc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.377666:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40520 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.377682:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40520 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.377697:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40520 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.377713:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40527 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.377719:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40527 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.377726:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40527 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378379:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af4052e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378391:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af4052e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378399:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af4052e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034603.378411:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1786034603.378618:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40520 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378627:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40520 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378641:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40520 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378648:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034603.378653:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40520 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378661:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40520 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378675:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96455a530000) 00010000:00010000:0.0:1786034603.378678:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034603.378682:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40520 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378689:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40520 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378704:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40527 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378710:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40527 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378717:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40527 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378722:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034603.378725:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40527 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378740:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40527 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378748:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff964547ee4800) 00010000:00010000:0.0:1786034603.378751:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034603.378753:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40527 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.378760:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40527 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.379538:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40519 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587fc expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.379555:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af4052e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587fc expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034603.379563:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9645521d1700) 00010000:00010000:0.0:1786034603.379566:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034603.379569:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8e00, rc 0) 00000100:00100000:0.0:1786034603.379651:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:11306:x1872792608900992:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 2152us (2444us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1786034603.379660:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 137 00000100:00100000:0.0:1786034603.394470:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034603.398809:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608901120 00000100:00100000:1.0:1786034603.398858:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608901120 00000100:00100000:1.0:1786034603.398948:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 138 00000100:00100000:1.0:1786034603.398960:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:11306:x1872792608901120:12345-192.168.203.56@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1786034603.399112:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:11306:x1872792608901120:12345-192.168.203.56@tcp:59:lhsmtool_posix.0 Request processed in 154us (4655us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034603.399131:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 138 00000100:00100000:2.0:1786034603.406044:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034603.406274:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608901248 00000100:00100000:3.0:1786034603.406286:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608901248 00000100:00100000:3.0:1786034603.406368:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:3.0:1786034603.406380:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454aced450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:2365:x1872792608901248:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034603.406399:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034603.406430:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af4052e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587fc expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034603.406455:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9645521d1700) 00010000:00010000:3.0:1786034603.406460:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034603.406526:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454aced450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:2365:x1872792608901248:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 148us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034603.406534:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:2.0:1786034603.568213:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636178304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034603.568300:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034603.568533:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636178304 00000100:00100000:1.0:1786034603.568542:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636178304 00000100:00100000:1.0:1786034603.568627:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1786034603.568640:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636178304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786034603.568681:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034603.568732:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636178304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034603.568750:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1786034603.568803:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636178304:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786034603.569007:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786034603.696056:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786034604.275216:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786034604.275226:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786034604.276270:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1786034604.276280:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786034604.721063:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034605.616130:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457471ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636178432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034605.616223:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034605.616225:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636178816:0@lo:400:kworker.0 00000100:00100000:0.0:1786034605.616278:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034605.616303:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636178944:0@lo:400:kworker.0 00000100:00100000:0.0:1786034605.616303:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786034605.616308:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636178688:0@lo:400:kworker.0 00000100:00100000:0.0:1786034605.616328:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034605.616329:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034605.616355:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636179200:0@lo:400:kworker.0 00000100:00100000:2.0:1786034605.616363:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786034605.616368:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636178560:0@lo:400:kworker.0 00000100:00100000:0.0:1786034605.616376:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034605.616398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034605.616411:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636178432 00000100:00100000:2.0:1786034605.616418:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636179072:0@lo:400:kworker.0 00000100:00100000:0.0:1786034605.616419:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636178432 00000100:00100000:2.0:1786034605.616440:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034605.616485:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1786034605.616494:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636178432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786034605.616538:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034605.616561:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636178816 00000100:00100000:3.0:1786034605.616566:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636178816 00000100:00100000:3.0:1786034605.616597:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636178688 00000100:00100000:3.0:1786034605.616600:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636178688 00000100:00100000:3.0:1786034605.616611:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636179072 00000100:00100000:3.0:1786034605.616614:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636179072 00000100:00100000:3.0:1786034605.616629:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1786034605.616636:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636178816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034605.616658:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1786034605.616667:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636178688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034605.616680:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636178816:12345-0@lo:400:kworker.0 Request processed in 45us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034605.616687:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1786034605.616698:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636178688:12345-0@lo:400:kworker.0 Request processed in 34us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034605.616703:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1786034605.616706:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1786034605.616712:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636179072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034605.616735:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636178560 00000100:00100000:1.0:1786034605.616738:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636178560 00000100:00100000:3.0:1786034605.616751:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636179072:12345-0@lo:400:kworker.0 Request processed in 39us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034605.616756:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1786034605.616766:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1786034605.616771:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636178560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034605.616794:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636179072:0@lo:400:kworker.0 00000100:00100000:1.0:1786034605.616798:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636178560:12345-0@lo:400:kworker.0 Request processed in 28us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034605.616804:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1786034605.616851:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636178944 00000100:00100000:3.0:1786034605.616852:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636178560:0@lo:400:kworker.0 00000100:00100000:1.0:1786034605.616860:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636178944 00000100:00080000:3.0:1786034605.616877:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786034605.616882:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786034605.616884:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786034605.616886:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636179200 00000100:00100000:1.0:1786034605.616889:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636179200 00000100:00100000:3.0:1786034605.616901:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1786034605.616906:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1786034605.616908:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636178944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034605.616911:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1872792636179200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034605.616941:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636178944:12345-0@lo:400:kworker.0 Request processed in 34us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034605.616947:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1786034605.616950:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1872792636179200:12345-0@lo:400:kworker.0 Request processed in 26us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034605.616955:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1786034605.616972:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636178944:0@lo:400:kworker.0 00000100:00100000:1.0:1786034605.616995:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636178688:0@lo:400:kworker.0 00000100:00100000:3.0:1786034605.617078:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636179200:0@lo:400:kworker.0 00000100:00100000:3.0:1786034605.617088:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636178816:0@lo:400:kworker.0 00000100:00100000:3.0:1786034605.618410:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636178432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1916us (2186us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034605.618473:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457471ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636178432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034605.628905:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00010000:2.0:1786034605.744007:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786034606.273423:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:1.0:1786034606.615080:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034606.615209:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608901376 00000100:00100000:3.0:1786034606.615221:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608901376 00000100:00100000:3.0:1786034606.615301:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 139 00000100:00100000:3.0:1786034606.615314:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:11349:x1872792608901376:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034606.615349:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034606.615382:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4053c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758803 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615459:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40543 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615475:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40543 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615490:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40543 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615503:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4054a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615510:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4054a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615517:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4054a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615877:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40543 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615886:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40543 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615894:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40543 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615900:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034606.615905:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40543 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615923:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40543 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615939:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119600) 00010000:00010000:3.0:1786034606.615942:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034606.615947:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40543 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615954:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40543 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615970:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4054a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615976:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4054a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615982:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4054a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615988:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034606.615991:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4054a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.615999:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4054a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.616007:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96454a119300) 00010000:00010000:3.0:1786034606.616009:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034606.616012:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4054a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.616039:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af4054a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.616076:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4053c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758803 expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.616088:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119600) 00010000:00010000:3.0:1786034606.616090:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034606.616094:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af4053c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758803 expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.616103:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0e00, rc 0) 00000100:00100000:3.0:1786034606.616173:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:11349:x1872792608901376:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 861us (1104us total) trans 0 rc 301/301 00000100:00100000:3.0:1786034606.616180:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 139 00000100:00080000:0.0:1786034606.616413:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034606.626275:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034606.626635:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608901632 00000100:00100000:3.0:1786034606.626647:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608901632 00000100:00100000:3.0:1786034606.626742:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 140 00000100:00100000:3.0:1786034606.626753:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:11349:x1872792608901632:12345-192.168.203.56@tcp:36:lfs.0 00010000:00010000:3.0:1786034606.626851:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034606.626885:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af3feba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75863c expref: 13 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.626905:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119600) 00010000:00010000:3.0:1786034606.626910:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034606.627205:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.627227:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40512 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587f5 expref: 5 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.627237:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.627275:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40512 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587f5 expref: 5 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.627290:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40512 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587f5 expref: 5 pid: 5861 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034606.627309:0:5863:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e26300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1872792636179328:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034606.627413:0:5863:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a943b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786034606.636768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034606.636891:0:5863:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e26300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1872792636179328:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034606.636925:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034606.636957:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608901760 00000100:00100000:1.0:1786034606.636965:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608901760 00010000:00010000:1.0:1786034606.637022:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40512 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587f5 expref: 6 pid: 5861 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034606.637059:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 59 00000100:00100000:1.0:1786034606.637069:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2363:x1872792608901760:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034606.637086:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034606.637095:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40512 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587f5 expref: 6 pid: 5861 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.637107:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40512 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587f5 expref: 6 pid: 5861 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.637150:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af40512 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587f5 expref: 6 pid: 5861 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.637168:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119600) 00010000:00010000:1.0:1786034606.637173:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.637183:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.637191:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.637213:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034606.637266:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608901760:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 198us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034606.637274:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 59 00010000:00010000:1.0:1786034606.637303:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.637310:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.637346:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40558 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.637357:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40558 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.637365:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40558 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034606.638647:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1786034606.638661:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.638671:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.638679:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.638686:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034606.638691:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.638701:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.638713:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119600) 00010000:00010000:1.0:1786034606.638716:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034606.638721:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.638728:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40551 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786034606.638746:0:5863:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000465cc35e reply state 00000000ab5bc298 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40558 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034606.638756:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786034606.638845:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:11349:x1872792608901632:12345-192.168.203.56@tcp:36:lfs.0 Request processed in 12070us (12560us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1786034606.638864:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 140 00000100:00080000:3.0:1786034606.638954:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786034606.644778:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40558 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.644797:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40558 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.644806:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40558 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.644813:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034606.644818:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40558 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.644871:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40558 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.644891:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9645521d1300) 00010000:00010000:3.0:1786034606.644894:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034606.644899:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40558 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.644906:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40558 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.770465:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034606.785045:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034606.785260:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608901888 00000100:00100000:0.0:1786034606.785269:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608901888 00000100:00100000:0.0:1786034606.785342:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 141 00000100:00100000:0.0:1786034606.785354:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:11357:x1872792608901888:12345-192.168.203.56@tcp:101:lctl.0 00010000:00010000:0.0:1786034606.785387:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034606.785409:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4055f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75880a expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.785815:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40566 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.787275:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.787294:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034606.787473:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1786034606.787478:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034606.787620:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.787654:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4055f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75880a expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.787675:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40566 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75880a expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.787684:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4800) 00010000:00010000:0.0:1786034606.787687:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034606.787690:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8c00, rc 0) 00000100:00100000:0.0:1786034606.787759:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:11357:x1872792608901888:12345-192.168.203.56@tcp:101:lctl.0 Request processed in 2407us (2720us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034606.787780:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 141 00000100:00100000:1.0:1786034606.903275:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034606.903353:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608902016 00000100:00100000:0.0:1786034606.903367:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608902016 00000100:00100000:0.0:1786034606.903473:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 142 00000100:00100000:0.0:1786034606.903484:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:11363:x1872792608902016:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:0.0:1786034606.903503:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034606.903523:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4056d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758811 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.903588:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40574 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.903618:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40574 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.903629:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40574 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.903644:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af4057b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.903650:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af4057b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.903655:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af4057b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.903758:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40582 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.905975:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906006:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034606.906071:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1786034606.906075:0:6743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034606.906102:0:6743:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906117:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40574 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906143:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40574 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906152:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40574 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906160:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034606.906164:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40574 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906173:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40574 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906187:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4800) 00010000:00010000:0.0:1786034606.906190:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034606.906194:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40574 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906201:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40574 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906217:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af4057b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906223:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af4057b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906230:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af4057b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906235:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034606.906242:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af4057b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906248:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af4057b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906257:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff964547ee4c00) 00010000:00010000:0.0:1786034606.906259:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034606.906262:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af4057b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906268:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af4057b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906310:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4056d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758811 expref: 16 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906325:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758811 expref: 15 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034606.906333:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034606.906348:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786034606.906351:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8a00, rc 0) 00000100:00100000:0.0:1786034606.906427:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:11363:x1872792608902016:12345-192.168.203.56@tcp:101:bash.0 Request processed in 2943us (3162us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034606.906436:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 142 00000100:00100000:2.0:1786034606.913569:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034606.913656:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608902272 00000100:00100000:1.0:1786034606.913666:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608902272 00000100:00100000:1.0:1786034606.913759:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 143 00000100:00100000:1.0:1786034606.913782:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+15:11363:x1872792608902272:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:1.0:1786034606.913802:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034606.913851:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40589 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758818 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.913984:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40590 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.913998:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40590 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914008:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40590 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914021:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40597 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914027:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914034:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786034606.914537:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1786034606.914686:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af4059e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914701:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af4059e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914709:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af4059e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914741:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40590 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914747:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40590 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914753:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40590 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914760:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034606.914764:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40590 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914771:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40590 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914782:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:1.0:1786034606.914785:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034606.914789:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40590 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914795:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40590 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786034606.914807:0:5861:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000450f28f7 reply state 000000002cffe77c transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034606.914839:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786034606.914869:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40589 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758818 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914883:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af4059e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758818 expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.914891:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1900) 00010000:00010000:1.0:1786034606.914893:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034606.914895:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01a00, rc 0) 00000100:00100000:1.0:1786034606.914962:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:11363:x1872792608902272:12345-192.168.203.56@tcp:101:bash.0 Request processed in 1194us (1402us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1786034606.914969:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 143 00010000:00010000:2.0:1786034606.918235:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034606.918250:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40597 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034606.918257:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40597 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034606.918264:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034606.918269:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40597 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034606.918276:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40597 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034606.918293:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9645521d1e00) 00010000:00010000:2.0:1786034606.918309:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034606.918315:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40597 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034606.918321:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40597 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034606.926482:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034606.926570:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608902400 00000100:00100000:3.0:1786034606.926579:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608902400 00000100:00100000:3.0:1786034606.926654:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 47 00000100:00100000:3.0:1786034606.926664:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608902400:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:3.0:1786034606.926682:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034606.926705:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af405ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75881f expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786034606.926731:0:6719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786034606.926749:0:6719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1786034606.926754:0:6719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034606.926763:0:6719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af405ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75881f expref: 6 pid: 6719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.926795:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af405ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75881f expref: 6 pid: 6719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786034606.926943:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786034606.926992:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0e00, rc 0) 00000100:00100000:3.0:1786034606.927055:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608902400:12345-192.168.203.56@tcp:101:bash.0 Request processed in 392us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034606.927062:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 47 00000100:00100000:3.0:1786034606.950069:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034606.950298:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608902528 00000100:00100000:1.0:1786034606.950307:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608902528 00000100:00100000:1.0:1786034606.950373:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 48 00000100:00100000:1.0:1786034606.950382:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:11363:x1872792608902528:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:1.0:1786034606.950399:0:6720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034606.950416:0:6720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758826 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.950447:0:6720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af405ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75881f expref: 7 pid: 6719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.950457:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034606.950461:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034606.950479:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 7 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.950513:0:6720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af405ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75881f expref: 7 pid: 6719 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.950526:0:6720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af405ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75881f expref: 7 pid: 6719 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034606.950538:0:6720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457471fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6720:1872792636179456:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034606.950659:0:6720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034606.967034:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034606.967117:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608902656 00000100:00100000:3.0:1786034606.967126:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608902656 00010000:00010000:3.0:1786034606.967161:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af405ac lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75881f expref: 8 pid: 6719 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034606.967206:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 60 00000100:00100000:3.0:1786034606.967214:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574deed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2363:x1872792608902656:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034606.967227:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034606.967247:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af405ac lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75881f expref: 8 pid: 6719 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.967259:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af405ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75881f expref: 8 pid: 6719 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.967281:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034606.967286:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034606.967293:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 8 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.967318:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 8 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034606.967364:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 8 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034606.967377:0:5848:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96455185bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5848:1872792636179584:192.168.203.56@tcp:105: 00000100:00100000:3.0:1786034606.967452:0:5848:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a943780 going to sleep for 11 seconds 00010000:00010000:1.0:1786034606.967772:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af405ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75881f expref: 8 pid: 6719 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034606.967787:0:6720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457471fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6720:1872792636179456:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034606.967813:0:6720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 7 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034606.967925:0:6720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00800, rc 0) 00000100:00100000:1.0:1786034606.967967:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:11363:x1872792608902528:12345-192.168.203.56@tcp:101:bash.0 Request processed in 17586us (17907us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034606.967974:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 48 00000100:00100000:0.0:1786034606.980185:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034606.980270:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608902912 00000100:00100000:1.0:1786034606.980279:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608902912 00000100:00100000:1.0:1786034606.980349:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 36 00000100:00100000:1.0:1786034606.980358:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+17:11363:x1872792608902912:12345-192.168.203.56@tcp:35:bash.0 00000100:00100000:1.0:1786034606.980712:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:11363:x1872792608902912:12345-192.168.203.56@tcp:35:bash.0 Request processed in 353us (535us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1786034606.980720:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 36 00000100:00100000:3.0:1786034606.981781:0:5848:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96455185bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5848:1872792636179584:192.168.203.56@tcp:105: 00010000:00010000:3.0:1786034606.981803:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034606.982017:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574deed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608902656:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 14802us (14989us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034606.982027:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 60 00000100:00100000:0.0:1786034607.106373:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034607.106852:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608903168 00000100:00100000:1.0:1786034607.106862:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608903168 00000100:00100000:1.0:1786034607.106920:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 144 00000100:00100000:1.0:1786034607.106942:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:11373:x1872792608903168:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:1.0:1786034607.106968:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034607.106987:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af405ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75882d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034607.107086:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1786034607.107185:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af405ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75882d expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.107199:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4800) 00010000:00010000:1.0:1786034607.107202:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786034607.107207:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af405ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75882d expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.107220:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00c00, rc 0) 00000100:00100000:1.0:1786034607.107275:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:11373:x1872792608903168:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 347us (910us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1786034607.107282:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 144 00000100:00100000:3.0:1786034607.109000:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034607.109152:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608903424 00000100:00100000:1.0:1786034607.109158:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608903424 00000100:00100000:1.0:1786034607.109199:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 37 00000100:00100000:1.0:1786034607.109217:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:11373:x1872792608903424:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:1.0:1786034607.109398:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:11373:x1872792608903424:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 181us (402us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1786034607.109405:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 37 00000100:00100000:0.0:1786034607.238788:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034607.238909:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608903552 00000100:00100000:3.0:1786034607.238919:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608903552 00000100:00100000:3.0:1786034607.238971:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 145 00000100:00100000:3.0:1786034607.238982:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:11379:x1872792608903552:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034607.239004:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034607.239022:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af405c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758834 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.239086:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af405cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.239115:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af405cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.239125:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af405cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034607.239188:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1786034607.239192:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786034607.239213:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af405cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.239236:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af405c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758834 expref: 22 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.239252:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af405cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758834 expref: 21 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.239259:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:3.0:1786034607.239262:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786034607.239264:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f1c00, rc 0) 00000100:00100000:3.0:1786034607.239320:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:11379:x1872792608903552:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 340us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034607.239326:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 145 00000100:00100000:0.0:1786034607.256968:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034607.257043:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608903808 00000100:00100000:3.0:1786034607.257052:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608903808 00000100:00100000:3.0:1786034607.257111:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 146 00000100:00100000:3.0:1786034607.257121:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:11379:x1872792608903808:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034607.257139:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034607.257171:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af405d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75883b expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.257283:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af405dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.257296:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af405dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.257308:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af405dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034607.257318:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1786034607.257457:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af405d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75883b expref: 24 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.257475:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af405dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75883b expref: 23 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.257483:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1900) 00010000:00010000:3.0:1786034607.257485:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034607.257488:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0e00, rc 0) 00000100:00100000:3.0:1786034607.257557:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+23:11379:x1872792608903808:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 429us (589us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1786034607.257570:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 146 00000100:00100000:2.0:1786034607.262744:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034607.262789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034607.262880:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608904192 00000100:00100000:3.0:1786034607.262889:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608904192 00000100:00100000:3.0:1786034607.262939:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 147 00000100:00100000:3.0:1786034607.262947:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+23:11379:x1872792608904192:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034607.262978:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034607.262996:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af405eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758842 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.263092:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af405f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034607.263097:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608903936 00000100:00100000:1.0:1786034607.263101:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608903936 00010000:00010000:3.0:1786034607.263106:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af405f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.263116:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af405f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034607.263127:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:1.0:1786034607.263130:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00100000:1.0:1786034607.263137:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+25:2362:x1872792608903936:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034607.263145:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034607.263161:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af405dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75883b expref: 25 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.263225:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1900) 00010000:00010000:1.0:1786034607.263230:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034607.263277:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+25:2362:x1872792608903936:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 140us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034607.263283:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 11 00010000:00010000:3.0:1786034607.263292:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af405eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758842 expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.263305:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af405f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758842 expref: 24 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.263311:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1900) 00010000:00010000:3.0:1786034607.263314:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786034607.263316:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312a00, rc 0) 00000100:00100000:3.0:1786034607.263350:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:11379:x1872792608904192:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 403us (561us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1786034607.264317:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 147 00000100:00100000:0.0:1786034607.285521:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034607.285706:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608904320 00000100:00100000:3.0:1786034607.285715:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608904320 00000100:00100000:3.0:1786034607.285779:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 49 00000100:00100000:3.0:1786034607.285799:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2365:x1872792608904320:12345-192.168.203.56@tcp:1:lfs.0 00010000:00010000:3.0:1786034607.285875:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4f633ce/0x490975051af40600 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.285902:0:6719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 6 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.285911:0:6719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034607.285916:0:6719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786034607.285921:0:6719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f633ce/0x490975051af40600 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.285953:0:6719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 6 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.285966:0:6719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 6 pid: 6720 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034607.285991:0:6719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457e073800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6719:1872792636179712:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034607.287818:0:6719:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a943780 going to sleep for 11 seconds 00000100:00100000:0.0:1786034607.298031:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034607.298938:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608904448 00000100:00100000:2.0:1786034607.298948:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608904448 00002000:00100000:2.0:1786034607.298993:0:6725:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff964574def800 x1872792608904448/t0(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:578/0 lens 504/0 e 0 to 0 dl 1786034618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786034607.299004:0:6725:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574def800 with x1872792608904448 ext(0->12) 00010000:00010000:2.0:1786034607.299013:0:6725:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 7 pid: 6720 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.299042:0:6725:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 7 pid: 6720 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786034607.299051:0:6725:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff964574def800 00000100:00100000:2.0:1786034607.299083:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 2 00000100:00100000:2.0:1786034607.299093:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2363:x1872792608904448:12345-192.168.203.56@tcp:4:lfs.0 00000100:00100000:2.0:1786034607.301110:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2363:x1872792608904448:12345-192.168.203.56@tcp:4:lfs.0 Request processed in 2014us (3091us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1786034607.301120:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 2 00002000:00100000:2.0:1786034607.301135:0:6725:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff964574def800 x1872792608904448/t4294967305(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:578/0 lens 504/448 e 0 to 0 dl 1786034618 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786034607.301145:0:6725:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574def800 with x1872792608904448 ext(0->12) 00010000:00010000:2.0:1786034607.301152:0:6725:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 9 pid: 6720 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.301165:0:6725:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 9 pid: 6720 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786034607.301172:0:6725:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff964574def800 00000100:00100000:3.0:1786034607.304271:0:6719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457e073800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6719:1872792636179712:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034607.304297:0:6719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e4f633ce/0x490975051af40600 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034607.312079:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034607.312210:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608904576 00000100:00100000:1.0:1786034607.312219:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608904576 00010000:00010000:1.0:1786034607.312259:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 9 pid: 6720 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034607.312302:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 61 00000100:00100000:1.0:1786034607.312312:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2364:x1872792608904576:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034607.312327:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786034607.312354:0:5846:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1786034607.312369:0:5846:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1786034606 00002000:00010000:1.0:1786034607.312372:0:5846:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1786034606 00002000:00010000:1.0:1786034607.312374:0:5846:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1786034606 00010000:00010000:1.0:1786034607.312382:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 9 pid: 6720 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.312396:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 9 pid: 6720 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.312420:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af405b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758826 expref: 9 pid: 6720 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.312437:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786034607.312442:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786034607.312448:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4f633ce/0x490975051af40600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.312457:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f633ce/0x490975051af40600 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.312490:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034607.312540:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2364:x1872792608904576:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 229us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034607.312547:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 61 00010000:00010000:0.0:1786034607.312775:0:6719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e4f633ce/0x490975051af40600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034607.312786:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4f633ce/0x490975051af40600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034607.312808:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4f633ce/0x490975051af40600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034607.312817:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f633ce/0x490975051af40600 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034607.312856:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4f633ce/0x490975051af40600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034607.312863:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313600 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034607.312867:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4f633ce/0x490975051af40600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034607.312876:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4f633ce/0x490975051af40600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034607.312888:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4f633ce/0x490975051af40600 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034607.312903:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4f633ce/0x490975051af40600 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034607.312945:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2365:x1872792608904320:12345-192.168.203.56@tcp:1:lfs.0 Request processed in 27147us (27432us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034607.312952:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 49 00000100:00100000:0.0:1786034607.325956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034607.326038:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608904832 00000100:00100000:1.0:1786034607.326047:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608904832 00000100:00100000:1.0:1786034607.326107:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 38 00000100:00100000:1.0:1786034607.326117:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542eec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:11379:x1872792608904832:12345-192.168.203.56@tcp:35:lfs.0 00000004:00010000:1.0:1786034607.326190:0:5865:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af405f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758842 expref: 24 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786034607.326433:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1786034607.326481:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1786034607.327070:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1786034607.327119:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.327135:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af4059e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758818 expref: 28 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.327144:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.327174:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af4059e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758818 expref: 28 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.327187:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af4059e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758818 expref: 28 pid: 5861 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034607.327202:0:5865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457471fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5865:1872792636179840:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034607.327285:0:5865:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034607.329949:0:5865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457471fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5865:1872792636179840:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034607.329978:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034607.330413:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034607.330477:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608904960 00000100:00100000:1.0:1786034607.330493:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608904960 00010000:00010000:1.0:1786034607.330519:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af4059e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758818 expref: 29 pid: 5861 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034607.330557:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 62 00000100:00100000:1.0:1786034607.330572:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574ded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:2362:x1872792608904960:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034607.330584:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034607.330591:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af4059e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758818 expref: 29 pid: 5861 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.330738:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af4059e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758818 expref: 29 pid: 5861 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.330761:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af4059e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758818 expref: 29 pid: 5861 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.330776:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1900) 00010000:00010000:1.0:1786034607.330780:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.330788:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.330795:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.330856:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034607.330900:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574ded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+28:2362:x1872792608904960:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 330us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034607.330916:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 62 00010000:00010000:2.0:1786034607.331584:0:5865:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.331593:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786034607.331781:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1786034607.331969:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1786034607.332084:0:5865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cdd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1872792636179968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786034607.332127:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034607.332194:0:5865:0:(client.c:2702:ptlrpc_set_wait()) set ffff964541370e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786034607.337883:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636179968 00000100:00100000:3.0:1786034607.337898:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636179968 00000100:00100000:3.0:1786034607.337981:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786034607.337991:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5865:x1872792636179968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1786034607.338249:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786034607.338710:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5865:x1872792636179968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 719us (6581us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034607.338718:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786034607.338787:0:5865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cdd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1872792636179968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1786034607.339866:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1786034607.339937:0:5865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cdd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1872792636180096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786034607.339976:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034607.340101:0:5865:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542f23e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786034607.340259:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636180096 00000100:00100000:0.0:1786034607.340264:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636180096 00000100:00100000:0.0:1786034607.340343:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1786034607.340352:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5865:x1872792636180096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786034607.340499:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5865:x1872792636180096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 148us (521us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1786034607.340506:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786034607.340570:0:5865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cdd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1872792636180096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1786034607.340612:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1786034607.340644:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.340654:0:5865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.340660:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.340666:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034607.340670:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.340677:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.340690:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1900) 00010000:00010000:2.0:1786034607.340693:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1786034607.340696:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.340702:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40607 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786034607.340870:0:5865:0:(mdd_object.c:4291:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1786034607.340998:0:5865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1786034607.341008:0:5865:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 443549184497ns, next at 444549182117ns, rc = 0 00000001:00080000:2.0:1786034607.341014:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1786034607.341421:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1900) 00010000:00010000:2.0:1786034607.341432:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786034607.341439:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af405f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758842 expref: 32 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034607.341532:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542eec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:11379:x1872792608904832:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 15416us (15584us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1786034607.341540:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 38 00000020:00080000:2.0:1786034607.341544:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1786034607.347694:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034607.348378:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608905088 00000100:00100000:1.0:1786034607.348387:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608905088 00000100:00100000:1.0:1786034607.348446:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 148 00000100:00100000:1.0:1786034607.348457:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:11379:x1872792608905088:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:1.0:1786034607.348480:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034607.348501:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af4060e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758849 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.348560:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af4060e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758849 expref: 32 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.348573:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af4060e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758849 expref: 32 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.348591:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:1.0:1786034607.348594:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786034607.348598:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01000, rc 0) 00000100:00100000:1.0:1786034607.348664:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:11379:x1872792608905088:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 208us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034607.348671:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 148 00000100:00100000:2.0:1786034607.352370:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034607.352426:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608905344 00000100:00100000:3.0:1786034607.352434:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608905344 00000100:00100000:3.0:1786034607.352486:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 39 00000100:00100000:3.0:1786034607.352493:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:11379:x1872792608905344:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:3.0:1786034607.356449:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:11379:x1872792608905344:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 3947us (4080us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1786034607.356462:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 39 00000100:00100000:2.0:1786034607.473496:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034607.473594:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608905600 00000100:00100000:1.0:1786034607.473603:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608905600 00000100:00100000:1.0:1786034607.473663:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 149 00000100:00100000:1.0:1786034607.473674:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:11389:x1872792608905600:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:1.0:1786034607.473697:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034607.473727:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758850 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034607.473868:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1786034607.473978:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40615 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758850 expref: 35 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.473992:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4800) 00010000:00010000:1.0:1786034607.473995:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786034607.474000:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758850 expref: 35 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.474014:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01a00, rc 0) 00000100:00100000:1.0:1786034607.474070:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+34:11389:x1872792608905600:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 398us (582us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1786034607.474077:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 149 00000100:00100000:1.0:1786034607.478815:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034607.479005:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608905728 00000100:00100000:3.0:1786034607.479013:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608905728 00000100:00100000:3.0:1786034607.479071:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 150 00000100:00100000:3.0:1786034607.479080:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+34:11389:x1872792608905728:12345-192.168.203.56@tcp:34:lfs.0 00010000:00010000:3.0:1786034607.479146:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af40623 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479162:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af40623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479182:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af40623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479197:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4062a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479221:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4062a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479229:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4062a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479312:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479320:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479326:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786034607.479514:0:6743:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479526:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af40623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479533:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af40623 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479539:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af40623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479545:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034607.479558:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af40623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479566:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af40623 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479584:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:3.0:1786034607.479587:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034607.479591:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af40623 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479598:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af40623 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479610:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4062a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479616:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4062a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479622:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4062a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479627:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034607.479630:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4062a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479637:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4062a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479645:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96454a119e00) 00010000:00010000:3.0:1786034607.479648:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034607.479651:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4062a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479656:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4062a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479683:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479689:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40631 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479695:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479700:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034607.479702:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479708:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40631 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479715:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:3.0:1786034607.479717:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034607.479719:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40631 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.479724:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40631 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034607.479790:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+34:11389:x1872792608905728:12345-192.168.203.56@tcp:34:lfs.0 Request processed in 709us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034607.479798:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 150 00000100:00100000:0.0:1786034607.483992:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034607.484114:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608905984 00000100:00100000:2.0:1786034607.484123:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608905984 00000100:00100000:2.0:1786034607.484170:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 40 00000100:00100000:2.0:1786034607.484189:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+34:11389:x1872792608905984:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:2.0:1786034607.484429:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+35:11389:x1872792608905984:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 241us (445us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1786034607.484436:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 40 00000100:00100000:2.0:1786034607.530075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034607.530151:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608906240 00000100:00100000:1.0:1786034607.530159:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608906240 00000100:00100000:1.0:1786034607.530223:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 151 00000100:00100000:1.0:1786034607.530231:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+35:11392:x1872792608906240:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:1.0:1786034607.530254:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034607.530271:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758857 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530347:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4063f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530360:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4063f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530381:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4063f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530393:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530399:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530404:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530506:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4064d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530512:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4064d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530518:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4064d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034607.530526:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1786034607.530618:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4063f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530624:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4063f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530630:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4063f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530634:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034607.530643:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4063f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530650:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4063f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530662:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:1.0:1786034607.530665:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034607.530669:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4063f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530675:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4063f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530687:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530692:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40646 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530697:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530701:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034607.530703:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530707:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530712:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9645521d1800) 00010000:00010000:1.0:1786034607.530714:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034607.530722:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40646 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530726:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530762:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758857 expref: 38 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530773:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4064d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758857 expref: 37 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.530779:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:1.0:1786034607.530781:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034607.530783:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01200, rc 0) 00000100:00100000:1.0:1786034607.530867:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:11392:x1872792608906240:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 636us (800us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1786034607.530873:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 151 00000100:00100000:1.0:1786034607.534968:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034607.535075:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608906368 00000100:00100000:2.0:1786034607.535084:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608906368 00000100:00100000:2.0:1786034607.535133:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 152 00000100:00100000:2.0:1786034607.535142:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:11392:x1872792608906368:12345-192.168.203.56@tcp:54:lfs.0 00010000:00010000:2.0:1786034607.535211:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4065b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.535226:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4065b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.535251:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4065b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.535274:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4065b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.535280:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4065b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.535287:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4065b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.535292:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034607.535295:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4065b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.535301:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4065b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.535311:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:2.0:1786034607.535314:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786034607.535318:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4065b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.535323:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4065b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034607.535389:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:11392:x1872792608906368:12345-192.168.203.56@tcp:54:lfs.0 Request processed in 247us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034607.535396:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 152 00000100:00100000:0.0:1786034607.538888:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034607.540498:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608906624 00000100:00100000:2.0:1786034607.540520:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608906624 00000100:00100000:2.0:1786034607.540653:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 41 00000100:00100000:2.0:1786034607.540665:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:11392:x1872792608906624:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:2.0:1786034607.540888:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+38:11392:x1872792608906624:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 226us (2006us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1786034607.540897:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 41 00010000:00010000:0.0:1786034607.795362:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034607.863809:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034607.863960:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608906880 00000100:00100000:1.0:1786034607.863969:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608906880 00000100:00100000:1.0:1786034607.864030:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 153 00000100:00100000:1.0:1786034607.864038:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+38:11423:x1872792608906880:12345-192.168.203.56@tcp:101:cat.0 00010000:00010000:1.0:1786034607.864061:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034607.864079:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40662 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75885e expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.864166:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40669 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.864194:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.864204:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034607.864214:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1786034607.864318:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40662 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75885e expref: 41 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.864345:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75885e expref: 40 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.864352:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:1.0:1786034607.864355:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034607.864358:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00c00, rc 0) 00000100:00100000:1.0:1786034607.864442:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+40:11423:x1872792608906880:12345-192.168.203.56@tcp:101:cat.0 Request processed in 404us (640us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1786034607.864449:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 153 00000100:00100000:1.0:1786034607.869780:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034607.869856:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034607.869986:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608907264 00000100:00100000:0.0:1786034607.869995:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608907264 00000100:00100000:0.0:1786034607.870064:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:0.0:1786034607.870074:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+40:2363:x1872792608907264:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034607.870088:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034607.870122:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40669 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75885e expref: 40 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034607.870139:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:0.0:1786034607.870143:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034607.870233:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+39:2363:x1872792608907264:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 160us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034607.870241:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:3.0:1786034607.871418:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608907136 00000100:00100000:3.0:1786034607.871425:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608907136 00000100:00100000:3.0:1786034607.871496:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 42 00000100:00100000:3.0:1786034607.871512:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+39:11423:x1872792608907136:12345-192.168.203.56@tcp:35:cat.0 00000100:00100000:3.0:1786034607.871727:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+40:11423:x1872792608907136:12345-192.168.203.56@tcp:35:cat.0 Request processed in 216us (1955us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1786034607.871735:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 42 00000100:00100000:1.0:1786034607.933400:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034607.933495:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608907520 00000100:00100000:2.0:1786034607.933505:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608907520 00000100:00100000:2.0:1786034607.933562:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 154 00000100:00100000:2.0:1786034607.933571:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+40:11429:x1872792608907520:12345-192.168.203.56@tcp:101:dd.0 00010000:00010000:2.0:1786034607.933595:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034607.933598:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786034607.933624:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af405cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758834 expref: 40 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.933644:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:2.0:1786034607.933649:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786034607.933661:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af40677 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758865 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.933748:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.933761:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4064d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758857 expref: 40 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.933769:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.933812:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4064d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758857 expref: 40 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034607.933868:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4064d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758857 expref: 40 pid: 5861 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034607.933883:0:5863:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cdc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1872792636180224:192.168.203.56@tcp:104: 00000100:00100000:2.0:1786034607.933972:0:5863:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645620a80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034607.937772:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034607.937867:0:5863:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cdc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1872792636180224:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034607.937899:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034607.938034:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608907648 00000100:00100000:1.0:1786034607.938041:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608907648 00010000:00010000:1.0:1786034607.938071:0:7671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4064d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758857 expref: 41 pid: 5861 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034607.938104:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 63 00000100:00100000:1.0:1786034607.938124:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454acef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+41:2363:x1872792608907648:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034607.938138:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034607.938144:0:7671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4064d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758857 expref: 41 pid: 5861 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.938155:0:7671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4064d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758857 expref: 41 pid: 5861 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.938174:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4064d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758857 expref: 41 pid: 5861 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.938187:0:7671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:1.0:1786034607.938192:0:7671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.938200:0:7671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.938207:0:7671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.938224:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034607.938263:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454acef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+40:2363:x1872792608907648:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 140us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034607.938270:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 63 00010000:00010000:0.0:1786034607.939175:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034607.939184:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034607.939201:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1786034607.939342:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af40677 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758865 expref: 41 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034607.939358:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758865 expref: 40 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034607.939366:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:0.0:1786034607.939369:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786034607.939372:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6600, rc 0) 00000100:00100000:0.0:1786034607.939412:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+40:11429:x1872792608907520:12345-192.168.203.56@tcp:101:dd.0 Request processed in 5842us (6021us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1786034607.939419:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 154 00000100:00100000:0.0:1786034607.942867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034607.942977:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608907904 00000100:00100000:1.0:1786034607.942986:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608907904 00000100:00100000:1.0:1786034607.943046:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 155 00000100:00100000:1.0:1786034607.943055:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+40:11429:x1872792608907904:12345-192.168.203.56@tcp:36:dd.0 00010000:00010000:1.0:1786034607.943280:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af4068c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.943295:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af4068c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034607.943305:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af4068c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786034607.943361:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1786034607.943383:0:5861:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000a5b5ccea reply state 000000007e8b0d29 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af4068c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034607.943391:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786034607.944396:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+43:11429:x1872792608907904:12345-192.168.203.56@tcp:36:dd.0 Request processed in 1339us (1532us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1786034607.944405:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 155 00000020:00080000:1.0:1786034607.944410:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786034607.950629:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af4068c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.950644:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af4068c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.950651:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af4068c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.950656:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034607.950660:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af4068c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.950669:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af4068c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.950684:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:3.0:1786034607.950687:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034607.950692:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af4068c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034607.950698:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af4068c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034607.965403:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034607.965455:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034607.965489:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034607.965594:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608908032 00000100:00100000:1.0:1786034607.965603:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608908032 00000100:00100000:1.0:1786034607.965657:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 316 00000100:00100000:1.0:1786034607.965667:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2365:x1872792608908032:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034607.965752:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2365:x1872792608908032:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 87us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034607.965760:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 316 00000100:00100000:2.0:1786034607.965929:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608908288 00000100:00100000:2.0:1786034607.965933:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608908288 00000100:00100000:2.0:1786034607.966000:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 200 00000100:00100000:2.0:1786034607.966008:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2365:x1872792608908288:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034607.966171:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2365:x1872792608908288:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 163us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034607.966189:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 200 00000100:00100000:3.0:1786034607.966353:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608908160 00000100:00100000:3.0:1786034607.966357:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608908160 00000100:00100000:3.0:1786034607.966403:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 91 00000100:00100000:3.0:1786034607.966421:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2365:x1872792608908160:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034607.966456:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2365:x1872792608908160:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 37us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034607.966461:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 91 00000100:00080000:0.0:1786034607.966539:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786034608.409802:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034608.409939:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608908416 00000100:00100000:3.0:1786034608.409948:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608908416 00000100:00100000:3.0:1786034608.410006:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 156 00000100:00100000:3.0:1786034608.410016:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+42:11443:x1872792608908416:12345-192.168.203.56@tcp:101:stat.0 00010000:00010000:3.0:1786034608.410037:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034608.410057:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40693 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75886c expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.410122:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4069a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.410136:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4069a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.410146:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4069a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.410158:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af406a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.410165:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af406a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.410171:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af406a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786034608.410380:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786034608.410531:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af406a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.410551:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758865 expref: 43 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.410561:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af406a8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.410590:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758865 expref: 43 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.410602:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758865 expref: 43 pid: 5863 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034608.410615:0:5862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457d41f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636180352:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034608.410693:0:5862:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a943480 going to sleep for 11 seconds 00000100:00100000:2.0:1786034608.417201:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034608.417319:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608908672 00000100:00100000:0.0:1786034608.417336:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608908672 00000100:00100000:0.0:1786034608.417391:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 43 00000100:00100000:0.0:1786034608.417400:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+44:5610:x1872792608908672:12345-192.168.203.56@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786034608.417689:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+45:5610:x1872792608908672:12345-192.168.203.56@tcp:35:ldlm_bl.0 Request processed in 289us (502us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1786034608.417697:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 43 00000100:00100000:3.0:1786034608.418317:0:5862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457d41f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636180352:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034608.418347:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af406a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034608.423688:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034608.423805:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608908800 00000100:00100000:0.0:1786034608.423813:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608908800 00010000:00010000:0.0:1786034608.423868:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758865 expref: 45 pid: 5863 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034608.423907:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 64 00000100:00100000:0.0:1786034608.423916:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+45:2363:x1872792608908800:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034608.424026:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034608.424035:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758865 expref: 45 pid: 5863 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034608.424048:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758865 expref: 45 pid: 5863 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034608.424087:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4067e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758865 expref: 45 pid: 5863 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034608.424102:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:0.0:1786034608.424107:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af406a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034608.424116:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af406a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034608.424124:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af406a8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034608.424186:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034608.424244:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+44:2363:x1872792608908800:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 328us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034608.424252:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 64 00010000:00010000:3.0:1786034608.427457:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af406a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.427471:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af406a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034608.427520:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1786034608.427536:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786034608.428001:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af406a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428018:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af406a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428029:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4069a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428035:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4069a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428043:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4069a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428049:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034608.428052:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4069a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428059:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4069a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428074:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:3.0:1786034608.428077:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034608.428081:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4069a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428087:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af4069a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428101:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af406a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428115:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af406a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428120:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af406a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428124:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034608.428127:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af406a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428132:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af406a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428139:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96454a119e00) 00010000:00010000:3.0:1786034608.428141:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034608.428144:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af406a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428148:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af406a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.428183:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40693 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75886c expref: 44 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.429073:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af406a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75886c expref: 43 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.429084:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:3.0:1786034608.429086:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034608.429097:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312a00, rc 0) 00000100:00100000:3.0:1786034608.429207:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+43:11443:x1872792608908416:12345-192.168.203.56@tcp:101:stat.0 Request processed in 19183us (19403us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034608.429216:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 156 00000100:00100000:2.0:1786034608.523764:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034608.523854:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608909056 00000100:00100000:3.0:1786034608.523864:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608909056 00000100:00100000:3.0:1786034608.523972:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 157 00000100:00100000:3.0:1786034608.523983:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+43:11449:x1872792608909056:12345-192.168.203.56@tcp:36:truncate.0 00010000:00010000:3.0:1786034608.524078:0:6743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034608.524105:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af406a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75886c expref: 43 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.524123:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:3.0:1786034608.524127:0:6743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034608.524320:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af406af lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.524343:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af406af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.524353:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af406af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786034608.524397:0:6743:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1786034608.524420:0:6743:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000089954ba6 reply state 0000000016c54ac7 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af406af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034608.524428:0:6743:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786034608.524514:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+45:11449:x1872792608909056:12345-192.168.203.56@tcp:36:truncate.0 Request processed in 533us (765us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1786034608.524530:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 157 00000020:00080000:3.0:1786034608.524535:0:6743:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786034608.532271:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af406af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.532289:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af406af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.532297:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af406af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.532304:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034608.532309:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af406af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.532316:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af406af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.532342:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:3.0:1786034608.532345:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034608.532350:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af406af lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034608.532355:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af406af lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034608.688234:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:0.0:1786034608.688282:0:6973:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 444896457796ns, next at 445896455489ns, rc = 0 00000100:00100000:1.0:1786034608.697727:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636180480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034608.697801:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034608.700206:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636180480 00000100:00100000:2.0:1786034608.700217:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636180480 00000100:00100000:2.0:1786034608.700285:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1786034608.700296:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636180480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786034608.700348:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034608.700423:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636180480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034608.700431:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1786034608.701666:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636180480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034608.800742:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034608.800858:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608909184 00000100:00100000:1.0:1786034608.800866:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608909184 00000100:00100000:1.0:1786034608.800912:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 158 00000100:00100000:1.0:1786034608.800921:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+44:11463:x1872792608909184:12345-192.168.203.56@tcp:101:stat.0 00010000:00010000:1.0:1786034608.800942:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034608.800960:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af406b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758873 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801028:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801042:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801054:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801068:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af406c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801074:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af406c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801081:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af406c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801158:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af406cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801165:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af406cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801187:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af406cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034608.801218:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1786034608.801221:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786034608.801238:0:5861:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af406cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801248:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af406cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801256:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801263:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801280:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801286:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034608.801290:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801297:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801309:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:1.0:1786034608.801311:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034608.801315:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801339:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801352:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af406c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801358:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af406c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801364:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af406c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801369:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034608.801372:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af406c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801378:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af406c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801385:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9645521d1800) 00010000:00010000:1.0:1786034608.801388:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034608.801390:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af406c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801397:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af406c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801425:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af406b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758873 expref: 46 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801436:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af406cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758873 expref: 45 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034608.801449:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:1.0:1786034608.801451:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034608.801454:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00c00, rc 0) 00000100:00100000:1.0:1786034608.801505:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+45:11463:x1872792608909184:12345-192.168.203.56@tcp:101:stat.0 Request processed in 585us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034608.801512:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 158 00010000:00010000:2.0:1786034608.817639:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034608.956290:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034608.956384:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608909440 00000100:00100000:0.0:1786034608.956393:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608909440 00000100:00100000:0.0:1786034608.956457:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 159 00000100:00100000:0.0:1786034608.956466:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+45:11473:x1872792608909440:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034608.956485:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034608.956504:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af406d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75887a expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034608.956617:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1786034608.956737:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af406d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75887a expref: 47 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034608.956751:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4800) 00010000:00010000:0.0:1786034608.956754:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786034608.956758:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af406d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75887a expref: 47 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034608.956771:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9800, rc 0) 00000100:00100000:0.0:1786034608.956870:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+46:11473:x1872792608909440:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 405us (588us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1786034608.956877:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 159 00000100:00100000:2.0:1786034608.963190:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034608.963264:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608909696 00000100:00100000:0.0:1786034608.963273:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608909696 00000100:00100000:0.0:1786034608.963333:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 44 00000100:00100000:0.0:1786034608.963342:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ef6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+46:11473:x1872792608909696:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:0.0:1786034608.963599:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ef6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+47:11473:x1872792608909696:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 257us (416us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1786034608.963606:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 44 00000100:00100000:2.0:1786034609.122394:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034609.122485:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608909952 00000100:00100000:1.0:1786034609.122495:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608909952 00000100:00100000:1.0:1786034609.122565:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 160 00000100:00100000:1.0:1786034609.122576:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+47:11479:x1872792608909952:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:1.0:1786034609.122598:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034609.122618:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af406e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758881 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034609.122713:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034609.122728:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af406cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758873 expref: 48 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034609.122736:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034609.122769:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af406cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758873 expref: 48 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034609.122801:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af406cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758873 expref: 48 pid: 5861 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034609.122815:0:5861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457471ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636180608:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034609.122944:0:5861:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645512c3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786034609.127262:0:5861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457471ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636180608:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034609.127291:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034609.134529:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034609.135215:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608910080 00000100:00100000:1.0:1786034609.135224:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608910080 00010000:00010000:1.0:1786034609.135263:0:7671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af406cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758873 expref: 49 pid: 5861 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034609.135302:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 65 00000100:00100000:1.0:1786034609.135311:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+49:2363:x1872792608910080:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034609.135336:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034609.135343:0:7671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af406cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758873 expref: 49 pid: 5861 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034609.135356:0:7671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af406cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758873 expref: 49 pid: 5861 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034609.135377:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af406cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758873 expref: 49 pid: 5861 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034609.135392:0:7671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:1.0:1786034609.135397:0:7671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034609.135424:0:7671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034609.135431:0:7671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034609.135461:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034609.135514:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+48:2363:x1872792608910080:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 204us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034609.135521:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 65 00010000:00010000:2.0:1786034609.136697:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.136708:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034609.136726:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1786034609.136896:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af406e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758881 expref: 49 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.136917:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758881 expref: 48 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.136925:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:2.0:1786034609.136928:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786034609.136939:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01a00, rc 0) 00000100:00100000:2.0:1786034609.136976:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+48:11479:x1872792608909952:12345-192.168.203.56@tcp:101:bash.0 Request processed in 14403us (14591us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1786034609.136984:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 160 00000100:00100000:0.0:1786034609.146668:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034609.153021:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608910336 00000100:00100000:2.0:1786034609.153035:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608910336 00000100:00100000:2.0:1786034609.153096:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 161 00000100:00100000:2.0:1786034609.153106:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+48:11479:x1872792608910336:12345-192.168.203.56@tcp:36:bash.0 00010000:00010000:2.0:1786034609.153374:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af406f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.153391:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af406f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.153401:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af406f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786034609.153450:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1786034609.153475:0:5863:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000fa96251a reply state 00000000bc6944b9 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af406f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034609.153482:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786034609.158294:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+51:11479:x1872792608910336:12345-192.168.203.56@tcp:36:bash.0 Request processed in 5178us (11624us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1786034609.158307:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 161 00000020:00080000:0.0:1786034609.158314:0:5863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786034609.174693:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00010000:00010000:3.0:1786034609.175232:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af406f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.175245:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af406f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.175266:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af406f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.175273:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034609.175278:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af406f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.175286:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af406f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.175301:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:3.0:1786034609.175304:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034609.175308:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af406f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.175314:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af406f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034609.175686:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608910464 00000100:00100000:0.0:1786034609.175695:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608910464 00000100:00100000:0.0:1786034609.175747:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 162 00000100:00100000:0.0:1786034609.175762:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+50:11479:x1872792608910464:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:0.0:1786034609.175785:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034609.175799:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af406fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758888 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.176354:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af40703 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.176370:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758881 expref: 51 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.176379:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af40703 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.176410:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758881 expref: 51 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.176433:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758881 expref: 51 pid: 5861 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034609.176448:0:5862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574ded180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636180736:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034609.176521:0:5862:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454f664b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786034609.179700:0:5862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574ded180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636180736:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034609.179727:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af40703 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034609.181314:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034609.181401:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608910592 00000100:00100000:2.0:1786034609.181410:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608910592 00010000:00010000:2.0:1786034609.181457:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758881 expref: 52 pid: 5861 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034609.181493:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 66 00000100:00100000:2.0:1786034609.181502:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+52:2362:x1872792608910592:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034609.181515:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034609.181539:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758881 expref: 52 pid: 5861 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.181558:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758881 expref: 52 pid: 5861 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.181579:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af406e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758881 expref: 52 pid: 5861 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.181593:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:2.0:1786034609.181597:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af40703 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.181606:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af40703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.181613:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af40703 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.181638:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034609.181690:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+51:2362:x1872792608910592:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 189us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034609.181697:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 66 00010000:00010000:3.0:1786034609.181938:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af40703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.181946:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af40703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034609.181986:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1786034609.181990:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786034609.182025:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af40703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.182054:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af406fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758888 expref: 51 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.182067:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af40703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758888 expref: 50 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.182075:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:3.0:1786034609.182078:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034609.182080:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9600, rc 0) 00000100:00100000:3.0:1786034609.182103:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+50:11479:x1872792608910464:12345-192.168.203.56@tcp:101:bash.0 Request processed in 6343us (7420us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034609.182110:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 162 00000100:00100000:0.0:1786034609.188218:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034609.188299:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608910848 00000100:00100000:2.0:1786034609.188308:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608910848 00000100:00100000:2.0:1786034609.188370:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 45 00000100:00100000:2.0:1786034609.188380:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+50:11479:x1872792608910848:12345-192.168.203.56@tcp:35:bash.0 00000100:00100000:2.0:1786034609.188721:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+51:11479:x1872792608910848:12345-192.168.203.56@tcp:35:bash.0 Request processed in 342us (511us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1786034609.188744:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 45 00000100:00100000:1.0:1786034609.276522:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034609.276719:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608911104 00000100:00100000:3.0:1786034609.276728:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608911104 00000100:00100000:3.0:1786034609.276819:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 163 00000100:00100000:3.0:1786034609.276860:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+51:11489:x1872792608911104:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034609.276882:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034609.276901:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4070a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75888f expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034609.277008:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1786034609.277133:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4070a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75888f expref: 53 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.277148:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4800) 00010000:00010000:3.0:1786034609.277162:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786034609.277167:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4070a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75888f expref: 53 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.277195:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312800, rc 0) 00000100:00100000:3.0:1786034609.277245:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+52:11489:x1872792608911104:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 386us (732us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1786034609.277252:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 163 00000100:00100000:0.0:1786034609.282098:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034609.284356:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608911232 00000100:00100000:2.0:1786034609.284368:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608911232 00000100:00100000:2.0:1786034609.284431:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 164 00000100:00100000:2.0:1786034609.284442:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+52:11489:x1872792608911232:12345-192.168.203.56@tcp:34:lfs.0 00010000:00010000:2.0:1786034609.284515:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af40718 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.284531:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af40718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.284632:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af40718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.284649:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4071f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.284657:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4071f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.284664:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4071f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.284991:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af40726 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285002:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af40726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285008:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af40726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786034609.285061:0:5861:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af40726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285074:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af40718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285080:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af40718 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285086:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af40718 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285092:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034609.285096:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af40718 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285103:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af40718 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285115:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:2.0:1786034609.285118:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034609.285122:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af40718 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285129:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af40718 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285140:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4071f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285146:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4071f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285157:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4071f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285161:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034609.285166:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4071f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285171:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4071f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285178:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96455a530c00) 00010000:00010000:2.0:1786034609.285180:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034609.285182:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4071f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285188:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af4071f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285202:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af40726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285208:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af40726 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285214:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af40726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285219:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034609.285221:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af40726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285237:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af40726 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285245:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:2.0:1786034609.285247:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034609.285250:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af40726 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.285256:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af40726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034609.285378:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+52:11489:x1872792608911232:12345-192.168.203.56@tcp:34:lfs.0 Request processed in 936us (3287us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034609.285386:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 164 00000100:00100000:1.0:1786034609.302001:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034609.306657:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608911488 00000100:00100000:2.0:1786034609.306670:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608911488 00000100:00100000:2.0:1786034609.306730:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 46 00000100:00100000:2.0:1786034609.306740:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+52:11489:x1872792608911488:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:2.0:1786034609.307125:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+53:11489:x1872792608911488:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 385us (5132us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1786034609.307133:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 46 00000100:00100000:1.0:1786034609.381151:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034609.386670:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608911744 00000100:00100000:0.0:1786034609.386683:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608911744 00000100:00100000:0.0:1786034609.386817:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 165 00000100:00100000:0.0:1786034609.386841:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+53:11492:x1872792608911744:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034609.386878:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034609.386897:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4072d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758896 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.386963:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40734 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.386976:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.386997:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.387011:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4073b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388357:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4073b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388370:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4073b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388491:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388500:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388507:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034609.388516:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1786034609.388620:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388627:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40734 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388633:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40734 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388639:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034609.388643:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40734 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388649:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40734 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388660:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034609.388663:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034609.388667:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40734 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388673:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40734 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388683:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4073b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388689:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4073b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388694:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4073b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388698:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034609.388706:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4073b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388711:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4073b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388718:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff964547ee4c00) 00010000:00010000:0.0:1786034609.388721:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034609.388724:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4073b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388729:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4073b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388765:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4072d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758896 expref: 56 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388777:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758896 expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.388784:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:0.0:1786034609.388786:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786034609.388789:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8200, rc 0) 00000100:00100000:0.0:1786034609.388879:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:11492:x1872792608911744:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 2040us (7737us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1786034609.388887:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 165 00000100:00100000:1.0:1786034609.393362:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034609.393395:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034609.393420:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608912000 00000100:00100000:1.0:1786034609.393428:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608912000 00000100:00100000:1.0:1786034609.393480:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 13 00000100:00100000:1.0:1786034609.393490:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457470b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:2365:x1872792608912000:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034609.393504:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034609.393527:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40742 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758896 expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034609.393555:0:7671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:1.0:1786034609.393560:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034609.393612:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457470b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+54:2365:x1872792608912000:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 123us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034609.393620:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 13 00000100:00100000:2.0:1786034609.394648:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608911872 00000100:00100000:2.0:1786034609.394661:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608911872 00000100:00100000:2.0:1786034609.394725:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 166 00000100:00100000:2.0:1786034609.394735:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457470bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+54:11492:x1872792608911872:12345-192.168.203.56@tcp:54:lfs.0 00010000:00010000:2.0:1786034609.394814:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40750 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.394890:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.394904:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.394939:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.394945:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40750 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.394952:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40750 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.394959:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034609.394963:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40750 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.394972:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40750 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.394983:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:2.0:1786034609.394986:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786034609.394991:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40750 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.394998:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40750 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034609.395675:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457470bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+54:11492:x1872792608911872:12345-192.168.203.56@tcp:54:lfs.0 Request processed in 939us (2319us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034609.395694:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 166 00000100:00100000:1.0:1786034609.408356:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034609.414704:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608912256 00000100:00100000:0.0:1786034609.414717:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608912256 00000100:00100000:0.0:1786034609.414782:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 47 00000100:00100000:0.0:1786034609.414792:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+54:11492:x1872792608912256:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:0.0:1786034609.416180:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:11492:x1872792608912256:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 1386us (7828us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1786034609.416404:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 47 00000100:00100000:1.0:1786034609.670504:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034609.670643:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608912512 00000100:00100000:3.0:1786034609.670655:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608912512 00000100:00100000:3.0:1786034609.670720:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 167 00000100:00100000:3.0:1786034609.670731:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:11510:x1872792608912512:12345-192.168.203.56@tcp:101:cat.0 00010000:00010000:3.0:1786034609.670761:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034609.670785:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40757 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75889d expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.670929:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4075e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.670945:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4075e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.670957:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4075e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034609.670968:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1786034609.671123:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40757 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75889d expref: 58 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.671156:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4075e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75889d expref: 57 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034609.671165:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:3.0:1786034609.671169:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1786034609.671172:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312a00, rc 0) 00000100:00100000:3.0:1786034609.671248:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+57:11510:x1872792608912512:12345-192.168.203.56@tcp:101:cat.0 Request processed in 519us (756us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1786034609.671255:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 167 00000100:00100000:1.0:1786034609.701984:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034609.702404:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608912640 00000100:00100000:2.0:1786034609.702416:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608912640 00000100:00100000:2.0:1786034609.702489:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 168 00000100:00100000:2.0:1786034609.702500:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+57:11511:x1872792608912640:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:2.0:1786034609.702530:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034609.702681:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4076c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7588a4 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.702766:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40773 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.702783:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.702796:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034609.702896:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1786034609.702900:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786034609.702927:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.702956:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4076c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588a4 expref: 59 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.702977:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588a4 expref: 58 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.703010:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:2.0:1786034609.703013:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786034609.703063:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7800, rc 0) 00000100:00100000:2.0:1786034609.703180:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+58:11511:x1872792608912640:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 680us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034609.703187:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 168 00000100:00100000:2.0:1786034609.721760:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034609.728175:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608913024 00000100:00100000:0.0:1786034609.728195:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608913024 00000100:00100000:0.0:1786034609.728384:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 48 00000100:00100000:0.0:1786034609.728397:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+58:11511:x1872792608913024:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:0.0:1786034609.728894:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+59:11511:x1872792608913024:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 498us (7146us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1786034609.728903:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 48 00000100:00100000:0.0:1786034609.746847:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034609.747029:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608913152 00000100:00100000:2.0:1786034609.747041:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608913152 00000100:00100000:2.0:1786034609.747121:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:2.0:1786034609.747134:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+59:11511:x1872792608913152:12345-192.168.203.56@tcp:103:lfs.0 00010000:00010000:2.0:1786034609.747155:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1786034609.747185:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af40703 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758888 expref: 59 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.747212:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4075e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75889d expref: 58 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.747226:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af4060e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758849 expref: 57 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.747237:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645521d1400) 00010000:00010000:2.0:1786034609.747251:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034609.747328:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+56:11511:x1872792608913152:12345-192.168.203.56@tcp:103:lfs.0 Request processed in 198us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034609.747348:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:3.0:1786034609.749360:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034609.749580:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608913280 00000100:00100000:2.0:1786034609.749590:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608913280 00000100:00100000:2.0:1786034609.749646:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 169 00000100:00100000:2.0:1786034609.749654:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+56:11511:x1872792608913280:12345-192.168.203.56@tcp:58:lfs.0 00010000:00010000:2.0:1786034609.749794:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4077a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.749813:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4077a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034609.749839:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4077a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786034609.750305:0:6743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1786034609.750441:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+56:11511:x1872792608913280:12345-192.168.203.56@tcp:58:lfs.0 Request processed in 787us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034609.750450:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 169 00000100:00100000:1.0:1786034609.794942:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034609.795050:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608913408 00000100:00100000:0.0:1786034609.795062:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608913408 00000100:00100000:0.0:1786034609.795137:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 170 00000100:00100000:0.0:1786034609.795148:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+56:11513:x1872792608913408:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034609.795175:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034609.795201:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40781 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7588ab expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795280:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40788 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795296:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795310:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795360:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4078f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795368:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4078f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795375:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4078f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795492:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40796 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795501:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795509:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034609.795606:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1786034609.795611:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034609.795632:0:5863:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795645:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795654:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795660:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40788 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795677:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795684:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034609.795689:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795696:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40788 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795710:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034609.795713:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034609.795717:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40788 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795724:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40788 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795738:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4078f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795743:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4078f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795749:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4078f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795753:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034609.795755:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4078f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795770:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4078f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795777:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff964547ee4c00) 00010000:00010000:0.0:1786034609.795780:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034609.795782:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4078f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795788:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4078f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.795818:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40781 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ab expref: 58 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.797626:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ab expref: 57 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034609.797636:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96455a530c00) 00010000:00010000:0.0:1786034609.797638:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034609.797641:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9800, rc 0) 00000100:00100000:1.0:1786034609.797815:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+57:11513:x1872792608913408:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 2667us (2884us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034609.797847:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 170 00010000:00010000:3.0:1786034609.840133:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786034610.383339:0:6746:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1786034610.383371:0:6746:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:2.0:1786034610.417366:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786034610.417376:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786034610.419169:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1786034610.419179:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786034610.419319:0:11732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cdc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11732:1872792636180864:192.168.203.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786034610.419415:0:11732:0:(client.c:2702:ptlrpc_set_wait()) set ffff964562567600 going to sleep for 11 seconds 00000100:00100000:1.0:1786034610.422733:0:11732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cdc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11732:1872792636180864:192.168.203.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786034610.460554:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034610.462132:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608913536 00000100:00100000:2.0:1786034610.462146:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608913536 00000100:00100000:2.0:1786034610.462237:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 171 00000100:00100000:2.0:1786034610.462250:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d41c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+57:11524:x1872792608913536:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786034610.462292:0:5861:0:(mdt_handler.c:8007:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786034610.462418:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d41c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+57:11524:x1872792608913536:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 Request processed in 172us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034610.462426:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 171 00000100:00080000:0.0:1786034610.462848:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034610.474785:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034610.475302:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608913664 00000100:00100000:2.0:1786034610.475325:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608913664 00000100:00100000:2.0:1786034610.475402:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 172 00000100:00100000:2.0:1786034610.475413:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+57:11524:x1872792608913664:12345-192.168.203.56@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1786034610.475484:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af4079d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475500:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af4079d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475510:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af4079d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475569:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af407a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475576:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af407a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475582:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af407a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475605:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af407ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475613:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af407ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475635:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af407ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034610.475671:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1786034610.475675:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786034610.475688:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af407ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475698:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af4079d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475705:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af4079d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475711:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af4079d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475717:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034610.475721:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af4079d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475727:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af4079d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475739:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9645521d1700) 00010000:00010000:2.0:1786034610.475741:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034610.475746:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af4079d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475752:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af4079d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475774:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af407a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475780:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af407a4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475785:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af407a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475790:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034610.475793:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af407a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475798:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af407a4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475804:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff96455a530d00) 00010000:00010000:2.0:1786034610.475806:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034610.475809:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af407a4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475814:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af407a4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475845:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af407ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475851:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af407ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475857:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af407ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475867:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034610.475870:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af407ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475875:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af407ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475882:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96455a530c00) 00010000:00010000:2.0:1786034610.475895:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034610.475899:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af407ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.475904:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af407ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034610.475982:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+57:11524:x1872792608913664:12345-192.168.203.56@tcp:34:lhsmtool_posix.0 Request processed in 571us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034610.475990:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 172 00000100:00100000:0.0:1786034610.479899:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034610.481016:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608913920 00000100:00100000:2.0:1786034610.481030:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608913920 00000100:00100000:2.0:1786034610.481100:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 173 00000100:00100000:2.0:1786034610.481110:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+57:11524:x1872792608913920:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786034610.481127:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034610.481147:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af407b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7588b2 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.481240:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.481273:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.481284:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034610.481297:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1786034610.481407:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.481414:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.481420:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.481425:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034610.481428:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.481434:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.481445:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96455a530c00) 00010000:00010000:2.0:1786034610.481448:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786034610.481452:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.481457:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.481493:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af407b2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588b2 expref: 59 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.481510:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9645521d1700) 00010000:00010000:2.0:1786034610.481513:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786034610.481517:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af407b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588b2 expref: 59 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.481528:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6a00, rc 0) 00000100:00100000:2.0:1786034610.481590:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+58:11524:x1872792608913920:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 482us (1697us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1786034610.481597:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 173 00000100:00100000:3.0:1786034610.496936:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034610.498249:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608914048 00000100:00100000:1.0:1786034610.498261:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608914048 00000100:00100000:1.0:1786034610.498339:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 174 00000100:00100000:1.0:1786034610.498351:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+58:11524:x1872792608914048:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786034610.498389:0:5863:0:(mdt_handler.c:8007:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786034610.498505:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+58:11524:x1872792608914048:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 Request processed in 155us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034610.498513:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 174 00000100:00100000:1.0:1786034610.502468:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034610.502977:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608914304 00000100:00100000:2.0:1786034610.502987:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608914304 00000100:00100000:2.0:1786034610.503057:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 175 00000100:00100000:2.0:1786034610.503066:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+58:11524:x1872792608914304:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786034610.503085:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034610.503088:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786034610.503117:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7800/0x490975051af40773 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588a4 expref: 58 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.503134:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:2.0:1786034610.503139:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786034610.503150:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af407c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7588b9 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786034610.503727:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1786034610.504666:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.504691:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.504702:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.504754:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af407c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588b9 expref: 60 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.504770:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588b9 expref: 59 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.504777:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96455a530d00) 00010000:00010000:2.0:1786034610.504780:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786034610.504783:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7600, rc 0) 00000100:00100000:2.0:1786034610.505202:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+59:11524:x1872792608914304:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 2136us (2742us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1786034610.505211:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 175 00000100:00100000:2.0:1786034610.515474:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034610.515578:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608914560 00000100:00100000:1.0:1786034610.515595:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608914560 00000100:00100000:1.0:1786034610.515670:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 176 00000100:00100000:1.0:1786034610.515682:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+59:11524:x1872792608914560:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786034610.515768:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034610.515802:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af407ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588b9 expref: 59 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.515857:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96455a530d00) 00010000:00010000:1.0:1786034610.515872:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786034610.515902:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af407dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.515918:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af407dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.515930:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af407dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.515946:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af407e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xffa28601 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.515954:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af407e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xffa28601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.515962:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af407e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xffa28601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.516052:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af407dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.516061:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af407dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.516069:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af407dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.516082:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034610.516088:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af407dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.516096:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af407dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.516106:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:1.0:1786034610.516109:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034610.516113:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af407dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.516119:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af407dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.516130:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af407e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xffa28601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.516137:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af407e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xffa28601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.516143:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af407e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xffa28601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.516148:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034610.516151:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af407e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xffa28601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.516157:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af407e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xffa28601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.516175:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xffa28601 (ffff9645521d1800) 00010000:00010000:1.0:1786034610.516177:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034610.516180:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af407e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xffa28601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.516186:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af407e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xffa28601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034610.516285:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+58:11524:x1872792608914560:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 604us (820us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786034610.516293:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 176 00000100:00100000:3.0:1786034610.520736:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034610.522497:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608914688 00000100:00100000:2.0:1786034610.522511:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608914688 00000100:00100000:2.0:1786034610.522575:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 177 00000100:00100000:2.0:1786034610.522586:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+58:11524:x1872792608914688:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786034610.522606:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034610.522628:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af407ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7588c0 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.522687:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af407f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.522699:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af407f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.522709:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af407f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.522800:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af407ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c0 expref: 60 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.522819:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af407f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c0 expref: 59 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.522861:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96455a530500) 00010000:00010000:2.0:1786034610.522863:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786034610.522866:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6400, rc 0) 00000100:00100000:2.0:1786034610.522942:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+59:11524:x1872792608914688:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 358us (2218us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034610.522950:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 177 00000100:00100000:2.0:1786034610.527304:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034610.527400:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608914944 00000100:00100000:3.0:1786034610.527409:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608914944 00000100:00100000:3.0:1786034610.527463:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 178 00000100:00100000:3.0:1786034610.527473:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+59:11524:x1872792608914944:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786034610.527549:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af407f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.527564:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af407f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.527575:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af407f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786034610.527958:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1786034610.527968:0:5862:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 446736144108ns, next at 447736141975ns, rc = 0 00000004:00010000:3.0:1786034610.528073:0:5862:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000000c42c773 reply state 00000000f7169103 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af407f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034610.528082:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786034610.528164:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:11524:x1872792608914944:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 692us (866us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1786034610.528171:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 178 00010000:00010000:3.0:1786034610.530584:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af407f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.530599:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af407f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.530607:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af407f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.530613:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034610.530627:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af407f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.530636:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af407f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.530653:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96455a530500) 00010000:00010000:3.0:1786034610.530656:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786034610.530660:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af407f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.530682:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af407f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034610.531627:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034610.531699:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608915072 00000100:00100000:3.0:1786034610.531708:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608915072 00000100:00100000:3.0:1786034610.531760:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 179 00000100:00100000:3.0:1786034610.531769:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+60:11524:x1872792608915072:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786034610.531855:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034610.531871:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af407ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7588c7 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.531987:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af407ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c7 expref: 61 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.532173:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af407ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c7 expref: 61 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.532197:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96455a530500) 00010000:00010000:3.0:1786034610.532200:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786034610.532203:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562313000, rc 0) 00000100:00100000:3.0:1786034610.532256:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:11524:x1872792608915072:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 488us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034610.532263:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 179 00000100:00100000:2.0:1786034610.541348:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034610.541476:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608915200 00000100:00100000:3.0:1786034610.541485:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608915200 00000100:00100000:3.0:1786034610.541560:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 50 00000100:00100000:3.0:1786034610.541575:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608915200:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1786034610.541986:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2363:x1872792608915200:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 Request processed in 415us (645us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1786034610.541995:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 50 00000100:00080000:2.0:1786034610.542370:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786034610.548630:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034610.550627:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608915456 00000100:00100000:1.0:1786034610.550642:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608915456 00000100:00100000:1.0:1786034610.550835:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 49 00000100:00100000:1.0:1786034610.550850:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:11524:x1872792608915456:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786034610.551519:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+62:11524:x1872792608915456:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 Request processed in 672us (2896us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1786034610.551527:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 49 00000100:00100000:3.0:1786034610.564804:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034610.565758:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608915712 00000100:00100000:1.0:1786034610.565774:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608915712 00000100:00100000:1.0:1786034610.565878:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 180 00000100:00100000:1.0:1786034610.565890:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+62:11524:x1872792608915712:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786034610.566055:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+62:11524:x1872792608915712:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 166us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034610.566065:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 180 00000100:00100000:2.0:1786034610.583668:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034610.583839:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608915840 00000100:00100000:1.0:1786034610.583858:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608915840 00000100:00100000:1.0:1786034610.583925:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 181 00000100:00100000:1.0:1786034610.583936:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+62:11524:x1872792608915840:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786034610.583962:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034610.583985:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40806 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7588ce expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.584084:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4080d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.584101:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4080d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.584114:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4080d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034610.584157:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786034610.584177:0:5861:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4080d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.584204:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40806 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ce expref: 64 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.584221:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4080d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ce expref: 63 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.584230:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96455a530500) 00010000:00010000:1.0:1786034610.584233:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786034610.584237:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00c00, rc 0) 00000100:00100000:1.0:1786034610.584297:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+63:11524:x1872792608915840:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 362us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034610.584321:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 181 00000100:00100000:1.0:1786034610.602455:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034610.602657:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608915968 00000100:00100000:2.0:1786034610.602670:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608915968 00000100:00100000:2.0:1786034610.602737:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 51 00000100:00100000:2.0:1786034610.602757:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2365:x1872792608915968:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786034610.602780:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034610.602802:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40814 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7588d5 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786034610.602851:0:6721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a74b9b1, blocks: 0x1 00010000:00010000:2.0:1786034610.602874:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1786034610.602878:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034610.602888:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40814 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588d5 expref: 8 pid: 6721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.602907:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40814 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588d5 expref: 8 pid: 6721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.602922:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6e00, rc 0) 00000100:00100000:2.0:1786034610.602994:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2365:x1872792608915968:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 238us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034610.603001:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 51 00000100:00100000:1.0:1786034610.615735:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034610.615852:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608916224 00000100:00100000:0.0:1786034610.615865:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608916224 00000100:00100000:0.0:1786034610.615931:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 182 00000100:00100000:0.0:1786034610.615943:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+63:11524:x1872792608916224:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786034610.616079:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+63:11524:x1872792608916224:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 138us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034610.616100:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 182 00000100:00100000:0.0:1786034610.626811:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034610.626924:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608916352 00000100:00100000:3.0:1786034610.626935:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608916352 00000100:00100000:3.0:1786034610.626996:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 52 00000100:00100000:3.0:1786034610.627005:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:11524:x1872792608916352:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786034610.627026:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034610.627047:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f633ce/0x490975051af4081b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7588dc expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.627084:0:8676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40814 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588d5 expref: 9 pid: 6721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.627093:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034610.627097:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034610.627101:0:8676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f633ce/0x490975051af4081b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588dc expref: 9 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.627137:0:8676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40814 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588d5 expref: 9 pid: 6721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.627150:0:8676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40814 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588d5 expref: 9 pid: 6721 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034610.627187:0:8676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1872792636180992:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034610.627280:0:8676:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf540 going to sleep for 11 seconds 00000100:00100000:3.0:1786034610.630852:0:8676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1872792636180992:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034610.630896:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e4f633ce/0x490975051af4081b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588dc expref: 9 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.630920:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562313600, rc 0) 00000100:00100000:3.0:1786034610.630976:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:11524:x1872792608916352:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 3970us (4177us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034610.630985:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 52 00000100:00100000:1.0:1786034610.639171:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034610.639266:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608916480 00000100:00100000:2.0:1786034610.639278:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608916480 00010000:00010000:2.0:1786034610.639336:0:7671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40814 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588d5 expref: 9 pid: 6721 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034610.639381:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 67 00000100:00100000:2.0:1786034610.639406:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2363:x1872792608916480:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034610.639425:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034610.639452:0:7671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40814 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588d5 expref: 9 pid: 6721 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.639476:0:7671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40814 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588d5 expref: 9 pid: 6721 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.639505:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ba28667/0x490975051af40814 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588d5 expref: 9 pid: 6721 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.639526:0:7671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034610.639531:0:7671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034610.639541:0:7671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4f633ce/0x490975051af4081b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588dc expref: 8 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.639553:0:7671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f633ce/0x490975051af4081b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588dc expref: 8 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034610.639601:0:7671:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e4f633ce/0x490975051af4081b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588dc expref: 8 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034610.639619:0:7671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f65f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7671:1872792636181120:192.168.203.56@tcp:105: 00000100:00100000:2.0:1786034610.639710:0:7671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca480 going to sleep for 11 seconds 00000100:00100000:0.0:1786034610.643883:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034610.645612:0:7671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f65f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7671:1872792636181120:192.168.203.56@tcp:105: 00010000:00010000:2.0:1786034610.645664:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034610.645725:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2363:x1872792608916480:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 6319us (6565us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034610.645737:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 67 00000100:00100000:1.0:1786034610.646556:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608916608 00000100:00100000:1.0:1786034610.646566:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608916608 00002000:00100000:1.0:1786034610.646622:0:6726:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff964574dfce00 x1872792608916608/t0(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:581/0 lens 504/0 e 0 to 0 dl 1786034621 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786034610.646634:0:6726:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574dfce00 with x1872792608916608 ext(0->8) 00002000:00010000:1.0:1786034610.646640:0:6726:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff964574dfce00 00000100:00100000:1.0:1786034610.646674:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 4 00000100:00100000:1.0:1786034610.646685:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2363:x1872792608916608:12345-192.168.203.56@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1786034610.647160:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:2363:x1872792608916608:12345-192.168.203.56@tcp:4:lhsmtool_posix.0 Request processed in 477us (3287us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1786034610.647168:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 4 00002000:00100000:1.0:1786034610.647174:0:6726:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff964574dfce00 x1872792608916608/t4294967314(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:581/0 lens 504/448 e 0 to 0 dl 1786034621 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786034610.647181:0:6726:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574dfce00 with x1872792608916608 ext(0->8) 00002000:00010000:1.0:1786034610.647184:0:6726:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff964574dfce00 00000100:00100000:1.0:1786034610.663700:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034610.663861:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608916736 00000100:00100000:2.0:1786034610.663874:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608916736 00000100:00100000:2.0:1786034610.663950:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 183 00000100:00100000:2.0:1786034610.663961:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+63:11524:x1872792608916736:12345-192.168.203.56@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1786034610.741027:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636181248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034610.741116:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034610.741168:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636181760:0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.741195:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034610.741227:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786034610.741233:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636181376:0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.741262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034610.741282:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636181888:0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.741305:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034610.743652:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636181504:0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.743692:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034610.743709:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636182016:0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.743728:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034610.743808:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034610.743814:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636181632:0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.743850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034610.743890:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636181248 00000100:00100000:0.0:1786034610.743898:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636181248 00000100:00100000:0.0:1786034610.743962:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1786034610.743971:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636181248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786034610.743998:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034610.744053:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636181248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (2936us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034610.744060:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1786034610.744084:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636181760 00000100:00100000:0.0:1786034610.744088:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636181760 00000100:00100000:0.0:1786034610.744111:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636182016 00000100:00100000:0.0:1786034610.744114:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636182016 00000100:00100000:0.0:1786034610.744130:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1786034610.744135:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636181760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.744163:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636181760:12345-0@lo:400:kworker.0 Request processed in 28us (2968us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034610.744169:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1786034610.744178:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1786034610.744183:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636182016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.744206:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636182016:12345-0@lo:400:kworker.0 Request processed in 23us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034610.744212:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1786034610.744229:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636181376 00000100:00100000:0.0:1786034610.744232:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636181376 00000100:00100000:0.0:1786034610.744256:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1786034610.744261:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636181376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.744287:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636181376:12345-0@lo:400:kworker.0 Request processed in 26us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034610.744292:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1786034610.744329:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636181888 00000100:00100000:0.0:1786034610.744333:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636181888 00000100:00100000:0.0:1786034610.744352:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636181504 00000100:00100000:0.0:1786034610.744354:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636181504 00000100:00100000:0.0:1786034610.744385:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636181632 00000100:00100000:0.0:1786034610.744388:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636181632 00000100:00100000:0.0:1786034610.744400:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1786034610.744405:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636181888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.744434:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636181888:12345-0@lo:400:kworker.0 Request processed in 28us (3128us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034610.744439:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1786034610.744449:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1786034610.744455:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636181504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.744476:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636181504:12345-0@lo:400:kworker.0 Request processed in 21us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034610.744481:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1786034610.744489:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1786034610.744494:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636181632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.746626:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636181632:12345-0@lo:400:kworker.0 Request processed in 2128us (2771us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034610.746640:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:0.0:1786034610.746678:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786034610.746683:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786034610.746686:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786034610.746719:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636181376:0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.746732:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636181888:0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.746924:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636181248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034610.746934:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1786034610.746939:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1786034610.746974:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636181760:0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.747013:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636181632:0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.747024:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636181504:0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.747032:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636182016:0@lo:400:kworker.0 00000100:00100000:0.0:1786034610.783280:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+63:11524:x1872792608916736:12345-192.168.203.56@tcp:44:lhsmtool_posix.0 Request processed in 119306us (119579us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034610.783296:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 183 00000001:00080000:1.0:1786034610.783349:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:1.0:1786034610.783373:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:1.0:1786034610.783396:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1786034610.783476:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1786034610.783506:0:5883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff964542f230c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1786034610.783511:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9645747e4600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96454afa5c00 00000020:00080000:1.0:1786034610.783514:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9645747e4500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9645592e8800 00000004:00080000:1.0:1786034610.783532:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1786034610.785201:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1786034610.785429:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1786034610.786081:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636182144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786034610.786151:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034610.786211:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786034610.786220:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636182272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1786034610.786246:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034610.786277:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636182144 00000100:00100000:0.0:1786034610.786286:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636182144 00000100:00100000:0.0:1786034610.786344:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636182272 00000100:00100000:0.0:1786034610.786348:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636182272 00000100:00100000:0.0:1786034610.786373:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786034610.786383:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636182144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786034610.787143:0:6720:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1786034610.787148:0:6720:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1786034609 00002000:00010000:0.0:1786034610.787150:0:6720:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786034610.787153:0:6720:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1786034609 -> 1786034609 00002000:00010000:0.0:1786034610.787155:0:6720:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1786034610.787210:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1872792636182144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 828us (1059us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1786034610.787219:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786034610.787239:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786034610.787247:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636182272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1786034610.787264:0:6720:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1786034610.787298:0:6720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a74b9ae, atime: 0x6a74b9ae, ctime: 0x6a74b9ae, blocks: 0xb 00010000:00010000:0.0:1786034610.787318:0:6720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c110bd4/0x490975051af40822 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.787339:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1786034610.787344:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786034610.787350:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c110bd4/0x490975051af40822 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.787367:0:6720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c110bd4/0x490975051af40822 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.787379:0:6720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c110bd4/0x490975051af40822 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.787387:0:6720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c110bd4/0x490975051af40822 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.787404:0:6720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786034610.789133:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034610.789915:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608916864 00000100:00100000:3.0:1786034610.789925:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608916864 00000100:00100000:3.0:1786034610.789961:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 55 00000100:00100000:3.0:1786034610.789969:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:2362:x1872792608916864:12345-192.168.203.56@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1786034610.790399:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1872792636182272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3148us (4146us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1786034610.790423:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1786034610.791344:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff964574dfd880/2, rc 0, transno 4294967307 00000100:00100000:3.0:1786034610.791355:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636182272:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786034610.798134:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034610.798150:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c110bd4/0x490975051af40822 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.798165:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9e00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034610.798170:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c110bd4/0x490975051af40822 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.798181:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c110bd4/0x490975051af40822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.798206:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c110bd4/0x490975051af40822 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.798214:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c110bd4/0x490975051af40822 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.798234:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034610.798236:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034610.798237:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786034610.798294:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff964574cc1500/2, rc 0, transno 4294967315 00000100:00100000:0.0:1786034610.798302:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636182144:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1786034610.867747:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786034610.883492:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1786034610.883744:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:2362:x1872792608916864:12345-192.168.203.56@tcp:16:lhsmtool_posix.0 Request processed in 93766us (94610us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034610.883759:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 55 00000001:00080000:2.0:1786034610.883804:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1786034610.886650:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034610.887124:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608917120 00000100:00100000:1.0:1786034610.887138:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608917120 00000100:00100000:1.0:1786034610.887206:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 184 00000100:00100000:1.0:1786034610.887217:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:11524:x1872792608917120:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786034610.887280:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034610.887322:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4080d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ce expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.887341:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96455a530500) 00010000:00010000:1.0:1786034610.887346:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786034610.887379:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40829 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.887393:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40829 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.887402:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40829 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786034610.887711:0:5863:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000f7f6b9ed reply state 00000000300972e2 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40829 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034610.887722:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786034610.887847:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:11524:x1872792608917120:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 631us (1203us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1786034610.887870:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 184 00000100:00100000:1.0:1786034610.902337:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034610.907184:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608917248 00000100:00100000:2.0:1786034610.907202:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608917248 00000100:00100000:2.0:1786034610.907286:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 56 00000100:00100000:2.0:1786034610.907300:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2362:x1872792608917248:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1786034610.907653:0:6721:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1786034610.907658:0:6721:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1786034609 -> 1786034608 00002000:00010000:2.0:1786034610.907661:0:6721:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1786034606 00002000:00010000:2.0:1786034610.907665:0:6721:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1786034609 -> 1786034608 00002000:00010000:2.0:1786034610.907668:0:6721:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1786034610.907753:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2362:x1872792608917248:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 Request processed in 457us (5428us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1786034610.907762:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 56 00010000:00010000:3.0:1786034610.908115:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40829 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.908126:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40829 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.908135:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40829 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.908152:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034610.908158:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40829 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.908472:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40829 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.908494:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96455a530500) 00010000:00010000:3.0:1786034610.908497:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034610.908503:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40829 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.908509:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40829 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034610.919449:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034610.919557:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608917504 00000100:00100000:0.0:1786034610.919570:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608917504 00000100:00100000:0.0:1786034610.919646:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 185 00000100:00100000:0.0:1786034610.919658:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:11524:x1872792608917504:12345-192.168.203.56@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1786034610.919760:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.919781:0:6743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af407f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c0 expref: 18 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.919792:0:6743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.919873:0:6743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af407f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c0 expref: 18 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.919889:0:6743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af407f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c0 expref: 18 pid: 6743 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034610.919906:0:6743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6743:1872792636182400:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034610.920024:0:6743:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454abd3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034610.922080:0:6743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6743:1872792636182400:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034610.922105:0:6743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034610.924967:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034610.935814:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608917632 00000100:00100000:3.0:1786034610.935852:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608917632 00010000:00010000:3.0:1786034610.935908:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af407f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c0 expref: 19 pid: 6743 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034610.935959:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 68 00000100:00100000:3.0:1786034610.935970:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454acec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:2363:x1872792608917632:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034610.935988:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034610.936006:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af407f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c0 expref: 19 pid: 6743 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.936020:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af407f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c0 expref: 19 pid: 6743 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.936047:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6400/0x490975051af407f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c0 expref: 19 pid: 6743 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.936063:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96455a530500) 00010000:00010000:3.0:1786034610.936069:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.936080:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.936088:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.936119:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034610.936186:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454acec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:2363:x1872792608917632:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 217us (11226us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034610.936193:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 68 00010000:00010000:3.0:1786034610.936382:0:6743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.936392:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.936425:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.936440:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.936493:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.936501:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034610.936505:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.936514:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.936523:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96455a530500) 00010000:00010000:3.0:1786034610.936526:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786034610.936531:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.936538:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40830 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034610.936586:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+17:11524:x1872792608917504:12345-192.168.203.56@tcp:55:lhsmtool_posix.0 Request processed in 16932us (17150us total) trans 0 rc -22/-22 00000100:00100000:3.0:1786034610.936595:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 185 00000100:00100000:3.0:1786034610.940659:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034610.940962:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608917760 00000100:00100000:0.0:1786034610.940972:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608917760 00000100:00100000:0.0:1786034610.941032:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 57 00000100:00100000:0.0:1786034610.941042:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2362:x1872792608917760:12345-192.168.203.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786034610.941091:0:6720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d311263e/0x490975051af40837 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.941124:0:6720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4f633ce/0x490975051af4081b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588dc expref: 8 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.941132:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786034610.941136:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786034610.941141:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d311263e/0x490975051af40837 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.941176:0:6720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4f633ce/0x490975051af4081b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588dc expref: 8 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.941189:0:6720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4f633ce/0x490975051af4081b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588dc expref: 8 pid: 8676 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034610.941204:0:6720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6720:1872792636182528:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034610.941280:0:6720:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454abd3840 going to sleep for 11 seconds 00000040:00080000:0.0:1786034610.943853:0:12449:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786034610.943864:0:12449:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786034610.943913:0:12449:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1786034610.943920:0:12449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786034610.950278:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034610.952790:0:6720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6720:1872792636182528:192.168.203.56@tcp:104: 00010000:00010000:0.0:1786034610.952852:0:6720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d311263e/0x490975051af40837 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034610.953576:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608917888 00000100:00100000:3.0:1786034610.953584:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608917888 00010000:00010000:3.0:1786034610.953628:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f633ce/0x490975051af4081b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588dc expref: 9 pid: 8676 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034610.953700:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 69 00000100:00100000:3.0:1786034610.953710:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2362:x1872792608917888:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034610.953728:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034610.953756:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e4f633ce/0x490975051af4081b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588dc expref: 9 pid: 8676 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.953770:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4f633ce/0x490975051af4081b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588dc expref: 9 pid: 8676 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.953795:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f633ce/0x490975051af4081b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588dc expref: 9 pid: 8676 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.953811:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786034610.953816:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786034610.953840:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d311263e/0x490975051af40837 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.953852:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d311263e/0x490975051af40837 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.953879:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034610.953942:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2362:x1872792608917888:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 232us (3676us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034610.953949:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 69 00010000:00010000:0.0:1786034610.955335:0:6720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d311263e/0x490975051af40837 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.955358:0:6720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d311263e/0x490975051af40837 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.955391:0:6720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d311263e/0x490975051af40837 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.955400:0:6720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d311263e/0x490975051af40837 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.955408:0:6720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d311263e/0x490975051af40837 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.955416:0:6720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9c00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034610.955421:0:6720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d311263e/0x490975051af40837 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.955430:0:6720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d311263e/0x490975051af40837 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.955445:0:6720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d311263e/0x490975051af40837 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034610.955452:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d311263e/0x490975051af40837 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034610.955531:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2362:x1872792608917760:12345-192.168.203.56@tcp:1:lhsmtool_posix.0 Request processed in 14489us (14881us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034610.955541:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 57 00000100:00100000:3.0:1786034610.969871:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034610.969955:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608918144 00000100:00100000:1.0:1786034610.969966:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608918144 00000100:00100000:1.0:1786034610.970038:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 186 00000100:00100000:1.0:1786034610.970047:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457470b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+17:11524:x1872792608918144:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786034610.970141:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4083e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.970158:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4083e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.970169:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4083e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.970406:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.970417:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af407ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c7 expref: 18 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.970424:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.970465:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af407ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c7 expref: 18 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.970479:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af407ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c7 expref: 18 pid: 6743 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034610.970503:0:5862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636182656:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034610.970600:0:5862:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455d0a9540 going to sleep for 11 seconds 00000100:00100000:3.0:1786034610.990619:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034610.990663:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608918272 00000100:00100000:3.0:1786034610.990675:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608918272 00010000:00010000:3.0:1786034610.990723:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af407ff lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c7 expref: 19 pid: 6743 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034610.990762:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 70 00000100:00100000:3.0:1786034610.990847:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:2362:x1872792608918272:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034610.990865:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034610.990872:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af407ff lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c7 expref: 19 pid: 6743 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.990889:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af407ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c7 expref: 19 pid: 6743 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.990916:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96455a530500) 00010000:00010000:3.0:1786034610.990922:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.990932:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.990939:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034610.990962:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034610.991027:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:2362:x1872792608918272:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 183us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034610.991044:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 70 00010000:00010000:1.0:1786034610.992428:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af407ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588c7 expref: 18 pid: 6743 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034610.992447:0:5862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636182656:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034610.992486:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.992573:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034610.992581:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786034610.992789:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1786034610.992954:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1786034610.992994:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1786034610.993212:0:5862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1872792636182784:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786034610.993268:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034610.993297:0:5862:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455d0a9900 going to sleep for 11 seconds 00000100:00100000:3.0:1786034610.995198:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636182784 00000100:00100000:3.0:1786034610.995210:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636182784 00000100:00100000:3.0:1786034611.013227:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786034611.013250:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5862:x1872792636182784:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786034611.013411:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5862:x1872792636182784:12345-0@lo:1000:mdt00_001.0 Request processed in 170us (20141us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034611.013419:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786034611.013496:0:5862:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1786034611.013504:0:5862:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff964574cc1500, transno 4294967315 00000100:00100000:1.0:1786034611.013520:0:5862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1872792636182784:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1786034611.014264:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1786034611.014347:0:5862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1872792636182912:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786034611.014398:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034611.027592:0:5862:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542db1540 going to sleep for 11 seconds 00000100:00100000:2.0:1786034611.034106:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636182912 00000100:00100000:2.0:1786034611.034149:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636182912 00000100:00100000:2.0:1786034611.034254:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786034611.034265:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1872792636182912:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786034611.034678:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5862:x1872792636182912:12345-0@lo:1000:mdt00_001.0 Request processed in 411us (20276us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1786034611.034689:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786034611.041584:0:5862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1872792636182912:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1786034611.041646:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041658:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041666:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041673:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034611.041678:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041686:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041704:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96455a530500) 00010000:00010000:0.0:1786034611.041708:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786034611.041713:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041720:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40845 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041750:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4077a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041765:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4077a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041771:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4077a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041776:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034611.041779:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4077a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041784:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4077a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041792:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96455a530c00) 00010000:00010000:0.0:1786034611.041794:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786034611.041797:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4077a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041802:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4077a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041850:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041866:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40796 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ab expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041876:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041937:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ab expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034611.041960:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ab expref: 21 pid: 5863 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034611.041975:0:5862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dff100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636183040:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034611.045632:0:5862:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454abd3840 going to sleep for 11 seconds 00000100:00100000:2.0:1786034611.058375:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034611.058376:0:5862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dff100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636183040:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034611.058414:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034611.059142:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608918400 00000100:00100000:3.0:1786034611.059150:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608918400 00010000:00010000:3.0:1786034611.059188:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ab expref: 22 pid: 5863 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034611.059267:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 71 00000100:00100000:3.0:1786034611.059277:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+22:2363:x1872792608918400:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034611.059302:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034611.059317:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ab expref: 22 pid: 5863 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034611.059329:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ab expref: 22 pid: 5863 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034611.059352:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af40796 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ab expref: 22 pid: 5863 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034611.059366:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96455a530c00) 00010000:00010000:3.0:1786034611.059383:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034611.059393:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034611.059400:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034611.059427:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034611.059487:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:2363:x1872792608918400:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 211us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034611.059495:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 71 00010000:00010000:1.0:1786034611.059576:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059585:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059596:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059604:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059612:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059618:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034611.059622:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059629:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059639:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96455a530c00) 00010000:00010000:1.0:1786034611.059642:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034611.059645:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059657:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af4084c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059668:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4083e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059673:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4083e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059679:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4083e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059684:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034611.059687:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4083e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059692:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4083e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059699:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96455a530c00) 00010000:00010000:1.0:1786034611.059701:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786034611.059704:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4083e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.059709:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4083e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034611.059920:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457470b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:11524:x1872792608918144:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 89873us (90060us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1786034611.059928:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 186 00000020:00080000:1.0:1786034611.059937:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1786034611.060660:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786034611.060666:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786034611.061420:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1786034611.061430:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786034611.065268:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034611.065338:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608918656 00000100:00100000:1.0:1786034611.065351:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608918656 00000100:00100000:1.0:1786034611.065462:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 50 00000100:00100000:1.0:1786034611.065474:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:11524:x1872792608918656:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1786034611.068337:0:5864:0:(mdd_object.c:4291:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1786034611.068460:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1786034611.068525:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40853 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.068542:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40853 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.068554:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40853 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.068563:0:5864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40853 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.068570:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40853 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.068576:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40853 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034611.068600:0:5864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786034611.068703:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+22:11524:x1872792608918656:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 Request processed in 3228us (3444us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1786034611.068712:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 50 00000020:00080000:1.0:1786034611.068717:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786034611.070805:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034611.070815:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40853 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034611.074694:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01000 already unused, calling callback (ffffffffc1761020) 00010000:00010000:3.0:1786034611.074700:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40853 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034611.074711:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40853 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034611.074727:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9645521d1b00) 00010000:00010000:3.0:1786034611.074730:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786034611.074734:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40853 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034611.074754:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40853 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034611.074776:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034611.074779:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034611.074781:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034611.888069:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034612.912074:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786034612.997617:0:12501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786034612.997626:0:12501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786034612.997664:0:12501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1786034612.997670:0:12501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786034613.095174:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034613.095211:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034613.095274:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034613.095310:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034613.095352:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034613.095376:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608919296 00000100:00100000:3.0:1786034613.095384:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608919296 00000100:00100000:3.0:1786034613.095436:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608918912 00000100:00100000:3.0:1786034613.095439:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608918912 00000100:00100000:2.0:1786034613.095527:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608919040 00000100:00100000:2.0:1786034613.095531:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608919040 00000100:00100000:2.0:1786034613.095556:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608919168 00000100:00100000:2.0:1786034613.095558:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608919168 00000100:00100000:2.0:1786034613.095576:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 94 00000100:00100000:2.0:1786034613.095586:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2365:x1872792608919040:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034613.095659:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2365:x1872792608919040:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 76us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034613.095666:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 94 00000100:00100000:2.0:1786034613.095679:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 95 00000100:00100000:2.0:1786034613.095684:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2365:x1872792608919168:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034613.095703:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2365:x1872792608919168:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 19us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034613.095708:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 95 00000100:00100000:3.0:1786034613.104301:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 204 00000100:00100000:3.0:1786034613.104324:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2365:x1872792608919296:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034613.104415:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2365:x1872792608919296:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 103us (9141us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034613.104422:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 204 00000100:00100000:3.0:1786034613.104439:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 205 00000100:00100000:3.0:1786034613.104445:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+22:2365:x1872792608918912:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034613.104471:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+22:2365:x1872792608918912:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 27us (9162us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034613.104476:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 205 00000100:00080000:2.0:1786034613.104646:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786034613.104652:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786034613.104655:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034613.106633:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608918784 00000100:00100000:0.0:1786034613.106643:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608918784 00000100:00100000:0.0:1786034613.106701:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 318 00000100:00100000:0.0:1786034613.106710:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454adea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2365:x1872792608918784:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034613.106767:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454adea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2365:x1872792608918784:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 59us (11602us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034613.106774:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 318 00000100:00100000:2.0:1786034613.131881:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034613.131968:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608919552 00000100:00100000:3.0:1786034613.131983:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608919552 00000100:00100000:3.0:1786034613.132031:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 187 00000100:00100000:3.0:1786034613.132039:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+22:11543:x1872792608919552:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034613.132057:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034613.132075:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4085a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7588e3 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.132326:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40861 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.132339:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40861 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.132350:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40861 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034613.132359:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1786034613.132504:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4085a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588e3 expref: 25 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.132596:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40861 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588e3 expref: 24 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.132605:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:3.0:1786034613.132609:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786034613.132612:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312800, rc 0) 00000100:00100000:3.0:1786034613.132663:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:11543:x1872792608919552:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 625us (790us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1786034613.132670:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 187 00000100:00100000:2.0:1786034613.138143:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034613.138317:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608919680 00000100:00100000:0.0:1786034613.138326:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608919680 00000100:00100000:0.0:1786034613.138376:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 188 00000100:00100000:0.0:1786034613.138385:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457476b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:11543:x1872792608919680:12345-192.168.203.56@tcp:34:lfs.0 00010000:00010000:0.0:1786034613.138452:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4086f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138468:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4086f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138490:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4086f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138505:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138512:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138518:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138748:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4087d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138756:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4087d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138763:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4087d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786034613.138797:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4087d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138808:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4086f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138816:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4086f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138850:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4086f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138865:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034613.138869:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4086f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138876:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4086f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138888:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034613.138890:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034613.138894:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4086f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138900:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af4086f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138912:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138918:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40876 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138925:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138929:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034613.138932:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138938:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40876 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138953:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9645821d2100) 00010000:00010000:0.0:1786034613.138955:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034613.138958:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40876 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138964:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af40876 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138976:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4087d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138982:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4087d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138987:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4087d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138991:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034613.138994:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4087d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.138999:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4087d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.139006:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2d00) 00010000:00010000:0.0:1786034613.139008:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034613.139010:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4087d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.139015:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af4087d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034613.140560:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457476b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:11543:x1872792608919680:12345-192.168.203.56@tcp:34:lfs.0 Request processed in 2171us (2418us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034613.140570:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 188 00000100:00100000:3.0:1786034613.210404:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034613.210901:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608919936 00000100:00100000:0.0:1786034613.210931:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608919936 00000100:00100000:0.0:1786034613.210981:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 189 00000100:00100000:0.0:1786034613.210990:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:11546:x1872792608919936:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034613.211008:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034613.211028:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af40884 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7588ea expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211089:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4088b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211102:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4088b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211113:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4088b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211126:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40892 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211132:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211139:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211407:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40899 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211415:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211427:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034613.211436:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1786034613.211515:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4088b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211522:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4088b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211529:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4088b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211535:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034613.211539:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4088b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211546:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4088b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211557:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034613.211560:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034613.211563:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4088b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211569:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4088b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211580:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211586:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40892 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211596:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211602:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034613.211604:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211610:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40892 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211616:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9645821d2d00) 00010000:00010000:0.0:1786034613.211618:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034613.211621:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40892 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211626:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40892 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211657:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9600/0x490975051af40884 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ea expref: 27 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211669:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ea expref: 26 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.211676:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2100) 00010000:00010000:0.0:1786034613.211678:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786034613.211680:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9c00, rc 0) 00000100:00100000:0.0:1786034613.211728:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:11546:x1872792608919936:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 739us (1333us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1786034613.211742:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 189 00000100:00100000:1.0:1786034613.217587:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034613.217634:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608920064 00000100:00100000:1.0:1786034613.217643:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608920064 00000100:00100000:1.0:1786034613.217692:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 190 00000100:00100000:1.0:1786034613.217701:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:11546:x1872792608920064:12345-192.168.203.56@tcp:54:lfs.0 00010000:00010000:1.0:1786034613.217772:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.217787:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.217798:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.217842:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.217850:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.217857:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.217863:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034613.217867:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.217874:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.217884:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2100) 00010000:00010000:1.0:1786034613.217888:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786034613.217899:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.217906:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034613.217968:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:11546:x1872792608920064:12345-192.168.203.56@tcp:54:lfs.0 Request processed in 269us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034613.217976:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 190 00000100:00100000:3.0:1786034613.226673:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034613.226873:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608920320 00000100:00100000:0.0:1786034613.226881:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608920320 00000100:00100000:0.0:1786034613.226931:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 51 00000100:00100000:0.0:1786034613.226941:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:11546:x1872792608920320:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:0.0:1786034613.227154:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:11546:x1872792608920320:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 213us (489us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1786034613.227162:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 51 00000100:00100000:1.0:1786034613.278866:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034613.280925:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608920576 00000100:00100000:3.0:1786034613.280935:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608920576 00000100:00100000:3.0:1786034613.280991:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 191 00000100:00100000:3.0:1786034613.281000:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:11072:x1872792608920576:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:3.0:1786034613.281030:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034613.281050:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af408ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7588f1 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.281144:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.281158:0:6743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40899 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ea expref: 28 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.281167:0:6743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.281199:0:6743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ea expref: 28 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.281213:0:6743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40899 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ea expref: 28 pid: 6743 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034613.281227:0:6743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6743:1872792636183168:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034613.281315:0:6743:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1786034613.292215:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034613.297759:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608920704 00000100:00100000:1.0:1786034613.297772:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608920704 00010000:00010000:1.0:1786034613.297813:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40899 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ea expref: 29 pid: 6743 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034613.297873:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 72 00000100:00100000:1.0:1786034613.297881:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:2363:x1872792608920704:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034613.297895:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034613.297901:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40899 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ea expref: 29 pid: 6743 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.297914:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40899 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ea expref: 29 pid: 6743 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.297933:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2100) 00010000:00010000:1.0:1786034613.297938:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.297956:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.297962:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.297980:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034613.298769:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:2363:x1872792608920704:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 887us (6559us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034613.298777:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 72 00010000:00010000:1.0:1786034613.298863:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40899 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ea expref: 28 pid: 6743 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034613.298877:0:6743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6743:1872792636183168:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034613.298897:0:6743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.298906:0:6743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.298911:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034613.298927:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1786034613.299065:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af408ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588f1 expref: 29 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.299080:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588f1 expref: 28 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.299101:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2100) 00010000:00010000:1.0:1786034613.299103:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786034613.299107:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312a00, rc 0) 00000100:00100000:1.0:1786034613.299134:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+28:11072:x1872792608920576:12345-192.168.203.56@tcp:101:bash.0 Request processed in 18135us (20276us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1786034613.299141:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 191 00000100:00100000:3.0:1786034613.301809:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034613.301894:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608920960 00000100:00100000:1.0:1786034613.301902:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608920960 00000100:00100000:1.0:1786034613.301958:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 192 00000100:00100000:1.0:1786034613.301967:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+28:11072:x1872792608920960:12345-192.168.203.56@tcp:36:bash.0 00010000:00010000:1.0:1786034613.302221:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.302236:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.302246:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786034613.302306:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1786034613.302329:0:5861:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000ef8bf137 reply state 00000000939847ea transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034613.302338:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1786034613.302408:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1786034613.313449:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:11072:x1872792608920960:12345-192.168.203.56@tcp:36:bash.0 Request processed in 11472us (11637us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1786034613.313462:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 192 00000020:00080000:1.0:1786034613.313484:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1786034613.318268:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034613.320539:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608921088 00000100:00100000:1.0:1786034613.320551:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608921088 00000100:00100000:1.0:1786034613.320603:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 193 00000100:00100000:1.0:1786034613.320612:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:11072:x1872792608921088:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:1.0:1786034613.320632:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034613.320651:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af408ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7588f8 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.320700:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af408ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588f8 expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.320713:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af408ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588f8 expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.320728:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2100) 00010000:00010000:1.0:1786034613.320730:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786034613.320733:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01a00, rc 0) 00000100:00100000:1.0:1786034613.320804:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+33:11072:x1872792608921088:12345-192.168.203.56@tcp:101:bash.0 Request processed in 194us (2545us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034613.320811:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 193 00000100:00100000:0.0:1786034613.323402:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034613.323475:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608921216 00000100:00100000:3.0:1786034613.323483:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608921216 00000100:00100000:3.0:1786034613.323527:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 58 00000100:00100000:3.0:1786034613.323535:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:11072:x1872792608921216:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:3.0:1786034613.323549:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034613.323567:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5539bdf/0x490975051af408d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7588ff expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786034613.323595:0:6721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a74b9b0, atime: 0x6a74b9ae, ctime: 0x6a74b9b0, blocks: 0xb 00010000:00010000:3.0:1786034613.323610:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1786034613.323614:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034613.323621:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5539bdf/0x490975051af408d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ff expref: 8 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.323633:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b5539bdf/0x490975051af408d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ff expref: 8 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.323643:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312200, rc 0) 00000100:00100000:3.0:1786034613.323687:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:11072:x1872792608921216:12345-192.168.203.56@tcp:101:bash.0 Request processed in 153us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034613.323692:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 58 00010000:00010000:2.0:1786034613.324034:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034613.324043:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034613.324050:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034613.324057:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034613.324061:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034613.324069:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034613.324082:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2100) 00010000:00010000:2.0:1786034613.324085:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034613.324089:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034613.324095:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af408c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034613.325469:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034613.325918:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608921344 00000100:00100000:2.0:1786034613.325924:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608921344 00002000:00010000:2.0:1786034613.325950:0:6725:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1786034613.325954:0:6725:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574dff100 with x1872792608921344 ext(0->18446744073709551615) 00002000:00010000:2.0:1786034613.325972:0:6725:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff964574dff100. 00000100:00100000:0.0:1786034613.328454:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 5 00000100:00100000:0.0:1786034613.328470:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2362:x1872792608921344:12345-192.168.203.56@tcp:10:bash.0 00002000:00010000:0.0:1786034613.328728:0:6725:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1786034613.328731:0:6725:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1786034608 -> 1786034612 00002000:00010000:0.0:1786034613.328733:0:6725:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1786034606 -> 1786034606 00002000:00010000:0.0:1786034613.328735:0:6725:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1786034608 -> 1786034612 00002000:00010000:0.0:1786034613.328737:0:6725:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1786034613.328805:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2362:x1872792608921344:12345-192.168.203.56@tcp:10:bash.0 Request processed in 341us (3338us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1786034613.328811:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 5 00002000:00010000:0.0:1786034613.328815:0:6725:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1786034613.328817:0:6725:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574dff100 with x1872792608921344 ext(0->18446744073709551615) 00002000:00010000:0.0:1786034613.328850:0:6725:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff964574dff100. 00000100:00100000:1.0:1786034613.407169:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034613.407265:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608921472 00000100:00100000:0.0:1786034613.407294:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608921472 00000100:00100000:0.0:1786034613.407350:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 194 00000100:00100000:0.0:1786034613.407360:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:11560:x1872792608921472:12345-192.168.203.56@tcp:34:lfs.0 00010000:00010000:0.0:1786034613.407427:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af408d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407443:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af408d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407454:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af408d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407467:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af408df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407473:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af408df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407479:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af408df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407734:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af408e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407744:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af408e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407751:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af408e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786034613.407788:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af408e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407810:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af408d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407816:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af408d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407858:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af408d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407864:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034613.407868:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af408d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407874:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af408d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407884:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034613.407887:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034613.407891:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af408d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407898:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af408d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407909:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af408df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407915:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af408df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407919:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af408df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407929:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034613.407931:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af408df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407936:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af408df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407942:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9645821d2d00) 00010000:00010000:0.0:1786034613.407944:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034613.407946:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af408df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407951:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9800/0x490975051af408df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407962:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af408e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407966:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af408e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407971:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af408e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407975:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034613.407977:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af408e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407981:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af408e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.407995:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2100) 00010000:00010000:0.0:1786034613.407998:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034613.408000:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af408e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.408006:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af408e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034613.408073:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:11560:x1872792608921472:12345-192.168.203.56@tcp:34:lfs.0 Request processed in 714us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034613.408080:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 194 00000100:00100000:2.0:1786034613.449170:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034613.449255:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608921728 00000100:00100000:1.0:1786034613.449264:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608921728 00000100:00100000:1.0:1786034613.449326:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 195 00000100:00100000:1.0:1786034613.449335:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+32:11563:x1872792608921728:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:1.0:1786034613.449353:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034613.449382:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af408ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758906 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449446:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af408f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449460:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af408f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449471:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af408f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449483:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af408fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449490:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af408fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449495:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af408fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449783:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40902 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449793:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449800:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034613.449809:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1786034613.449924:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af408f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449940:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af408f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449947:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af408f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449952:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034613.449956:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af408f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449962:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af408f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449973:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:1.0:1786034613.449976:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034613.449980:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af408f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449986:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af408f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.449997:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af408fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.450002:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af408fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.450008:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af408fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.450024:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034613.450033:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af408fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.450040:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af408fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.450048:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9645521d1800) 00010000:00010000:1.0:1786034613.450051:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034613.450053:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af408fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.450059:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af408fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.450187:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af408ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758906 expref: 35 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.450201:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40902 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758906 expref: 34 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.450208:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2100) 00010000:00010000:1.0:1786034613.450211:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786034613.450213:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01200, rc 0) 00000100:00100000:1.0:1786034613.450275:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+34:11563:x1872792608921728:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 940us (1114us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1786034613.450282:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 195 00000100:00100000:2.0:1786034613.453473:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034613.455726:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608921856 00000100:00100000:0.0:1786034613.455736:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608921856 00000100:00100000:0.0:1786034613.455817:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 196 00000100:00100000:0.0:1786034613.455839:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+34:11563:x1872792608921856:12345-192.168.203.56@tcp:54:lfs.0 00010000:00010000:0.0:1786034613.455903:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.455919:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588f1 expref: 34 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.455928:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.455959:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588f1 expref: 34 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.455972:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588f1 expref: 34 pid: 6743 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034613.456007:0:5862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dff800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636183296:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034613.456091:0:5862:0:(client.c:2702:ptlrpc_set_wait()) set ffff964552589840 going to sleep for 11 seconds 00000100:00100000:2.0:1786034613.463976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034613.464081:0:5862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dff800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636183296:192.168.203.56@tcp:104: 00010000:00010000:0.0:1786034613.464157:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034613.464216:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608922112 00000100:00100000:3.0:1786034613.464222:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608922112 00000100:00100000:3.0:1786034613.464272:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 52 00000100:00100000:3.0:1786034613.464280:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+35:5609:x1872792608922112:12345-192.168.203.56@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1786034613.464568:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+36:5609:x1872792608922112:12345-192.168.203.56@tcp:35:ldlm_bl.0 Request processed in 287us (601us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1786034613.464587:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 52 00000100:00100000:2.0:1786034613.466563:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034613.469270:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608922240 00000100:00100000:3.0:1786034613.469286:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608922240 00010000:00010000:3.0:1786034613.469341:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588f1 expref: 36 pid: 6743 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034613.469425:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 73 00000100:00100000:3.0:1786034613.469434:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+36:2362:x1872792608922240:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034613.469448:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034613.469462:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588f1 expref: 36 pid: 6743 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.469475:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588f1 expref: 36 pid: 6743 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.469496:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af408b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588f1 expref: 36 pid: 6743 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.469521:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2100) 00010000:00010000:3.0:1786034613.469526:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.469535:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.469542:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.469584:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034613.470606:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+35:2362:x1872792608922240:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 1170us (4092us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034613.470615:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 73 00010000:00010000:0.0:1786034613.470680:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.470688:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.470715:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.470721:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.470728:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.470733:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034613.470737:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.470743:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.470753:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2100) 00010000:00010000:0.0:1786034613.470763:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786034613.470767:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.470773:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40910 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034613.470810:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+34:11563:x1872792608921856:12345-192.168.203.56@tcp:54:lfs.0 Request processed in 14974us (17345us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034613.470817:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 196 00000100:00100000:2.0:1786034613.479238:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034613.479684:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608922496 00000100:00100000:3.0:1786034613.479694:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608922496 00000100:00100000:3.0:1786034613.479775:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 53 00000100:00100000:3.0:1786034613.479784:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457476ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+34:11563:x1872792608922496:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:3.0:1786034613.480052:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457476ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+35:11563:x1872792608922496:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 269us (823us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1786034613.480060:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 53 00000100:00100000:2.0:1786034613.585164:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034613.585283:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608922752 00000100:00100000:1.0:1786034613.585302:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608922752 00000100:00100000:1.0:1786034613.585356:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 197 00000100:00100000:1.0:1786034613.585366:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457476aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+35:11574:x1872792608922752:12345-192.168.203.56@tcp:101:cat.0 00010000:00010000:1.0:1786034613.585402:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034613.585421:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40917 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75890d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.585485:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4091e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.585498:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4091e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.585519:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4091e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.585533:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40925 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.585540:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.585547:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.585815:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4092c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.585853:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4092c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.585861:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4092c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034613.585870:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1786034613.585956:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4091e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.585963:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4091e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.585969:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4091e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.585976:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034613.585980:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4091e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.585987:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4091e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.585997:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:1.0:1786034613.586000:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034613.586004:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4091e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.586010:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af4091e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.586032:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.586038:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40925 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.586044:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40925 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.586049:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034613.586057:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40925 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.586064:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40925 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.586072:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9645521d1800) 00010000:00010000:1.0:1786034613.586075:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034613.586077:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40925 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.586083:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40925 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.586128:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40917 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75890d expref: 38 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.586141:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4092c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75890d expref: 37 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.586148:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2100) 00010000:00010000:1.0:1786034613.586150:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034613.586152:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00c00, rc 0) 00000100:00100000:1.0:1786034613.586207:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457476aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:11574:x1872792608922752:12345-192.168.203.56@tcp:101:cat.0 Request processed in 842us (1051us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1786034613.586214:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 197 00000100:00100000:0.0:1786034613.600261:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034613.601184:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608923008 00000100:00100000:1.0:1786034613.601193:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608923008 00000100:00100000:1.0:1786034613.601246:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 54 00000100:00100000:1.0:1786034613.601256:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:11574:x1872792608923008:12345-192.168.203.56@tcp:35:cat.0 00000100:00100000:1.0:1786034613.601491:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+38:11574:x1872792608923008:12345-192.168.203.56@tcp:35:cat.0 Request processed in 236us (1237us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1786034613.601498:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 54 00000100:00100000:2.0:1786034613.650236:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034613.650370:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608923264 00000100:00100000:1.0:1786034613.650380:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608923264 00000100:00100000:1.0:1786034613.650436:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 198 00000100:00100000:1.0:1786034613.650445:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+38:11575:x1872792608923264:12345-192.168.203.56@tcp:36:rm.0 00010000:00010000:1.0:1786034613.650496:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1786034613.650520:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af4092c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75890d expref: 38 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.650542:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40902 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758906 expref: 37 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.650556:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af408ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588f8 expref: 36 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.650565:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2100) 00010000:00010000:1.0:1786034613.650575:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786034613.650594:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af4093a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.650607:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af4093a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.650616:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af4093a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.650645:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40941 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.650652:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40941 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.650658:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40941 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651147:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40948 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651157:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40948 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651165:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40948 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786034613.651767:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1786034613.651776:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 449859951901ns, next at 450859949768ns, rc = 0 00010000:00010000:0.0:1786034613.651846:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4094f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651856:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4094f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651863:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4094f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651871:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4094f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651885:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4094f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651891:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4094f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651913:0:5861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786034613.651932:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40948 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651938:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40948 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651944:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40948 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651950:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034613.651954:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40948 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651961:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40948 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651971:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2d00) 00010000:00010000:0.0:1786034613.651973:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786034613.651986:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40948 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.651992:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af40948 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.652007:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af4093a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.652227:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034613.652234:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4094f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.652240:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9200 already unused, calling callback (ffffffffc1761020) 00010000:00010000:3.0:1786034613.652244:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4094f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.652250:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4094f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.652260:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9645821d2d00) 00010000:00010000:3.0:1786034613.652262:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786034613.652265:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4094f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.652270:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af4094f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.652386:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034613.652388:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034613.652390:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034613.652431:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af4093a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.652439:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af4093a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.652444:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034613.652447:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af4093a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.652453:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af4093a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.652462:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034613.652464:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034613.652468:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af4093a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.652474:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af4093a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786034613.652499:0:5861:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000136792c9 reply state 00000000beb4b335 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40941 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034613.652582:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786034613.652959:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+37:11575:x1872792608923264:12345-192.168.203.56@tcp:36:rm.0 Request processed in 2513us (2730us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1786034613.652967:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 198 00010000:00010000:3.0:1786034613.668107:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40941 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.668124:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40941 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.668132:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40941 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.668140:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034613.668144:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40941 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.668152:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40941 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.668169:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9645521d1800) 00010000:00010000:3.0:1786034613.668173:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034613.668177:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40941 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.668183:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40941 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034613.747604:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034613.747737:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608923520 00000100:00100000:1.0:1786034613.747746:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608923520 00000100:00100000:1.0:1786034613.747799:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 199 00000100:00100000:1.0:1786034613.747809:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457476b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+36:11581:x1872792608923520:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:1.0:1786034613.747856:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034613.747874:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40956 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758914 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.748036:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4095d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.748051:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4095d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.748061:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4095d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.748074:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40964 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.748081:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.748110:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786034613.750478:0:5863:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1786034613.750652:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4096b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.750674:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4096b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.750686:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4096b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.750719:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4095d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.750726:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4095d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.750734:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4095d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.750741:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034613.750745:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4095d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.750752:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4095d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.750762:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034613.750765:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034613.750769:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4095d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.750774:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af4095d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786034613.750786:0:5863:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000cc5c8069 reply state 00000000c468170b transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034613.750800:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786034613.750866:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40956 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758914 expref: 39 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.750881:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4096b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758914 expref: 38 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034613.750888:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9645821d2e00) 00010000:00010000:0.0:1786034613.750890:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786034613.750893:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9400, rc 0) 00000100:00100000:0.0:1786034613.750959:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457476b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+39:11581:x1872792608923520:12345-192.168.203.56@tcp:101:bash.0 Request processed in 3151us (3373us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1786034613.750968:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 199 00010000:00010000:3.0:1786034613.753950:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.753965:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40964 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.753983:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40964 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.753989:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034613.753993:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40964 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.754000:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40964 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.754014:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9645521d1600) 00010000:00010000:3.0:1786034613.754017:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034613.754021:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40964 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.754027:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40964 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034613.761954:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034613.762179:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608923648 00000100:00100000:1.0:1786034613.762189:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608923648 00000100:00100000:1.0:1786034613.762305:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 59 00000100:00100000:1.0:1786034613.762315:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2364:x1872792608923648:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:1.0:1786034613.762342:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034613.762362:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af40979 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75891b expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786034613.762388:0:8676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034613.762405:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1786034613.762410:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034613.762419:0:8676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af40979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75891b expref: 6 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.762436:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af40979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75891b expref: 6 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034613.762449:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00800, rc 0) 00000100:00100000:1.0:1786034613.762504:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2364:x1872792608923648:12345-192.168.203.56@tcp:101:bash.0 Request processed in 191us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034613.762512:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 59 00000100:00100000:2.0:1786034613.771894:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034613.772028:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608923776 00000100:00100000:3.0:1786034613.772037:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608923776 00000100:00100000:3.0:1786034613.772091:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 60 00000100:00100000:3.0:1786034613.772101:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:11581:x1872792608923776:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:3.0:1786034613.772118:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034613.772136:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758922 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.772167:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af40979 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75891b expref: 7 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.772195:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034613.772200:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034613.772206:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 7 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.772240:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af40979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75891b expref: 7 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.772251:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af40979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75891b expref: 7 pid: 8676 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034613.772265:0:6721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6721:1872792636183424:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034613.772367:0:6721:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560a95840 going to sleep for 11 seconds 00000100:00100000:3.0:1786034613.778490:0:6721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6721:1872792636183424:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034613.778531:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 7 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.778552:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312a00, rc 0) 00000100:00100000:3.0:1786034613.778602:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:11581:x1872792608923776:12345-192.168.203.56@tcp:101:bash.0 Request processed in 6503us (6718us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034613.778610:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 60 00000100:00100000:2.0:1786034613.780760:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034613.780874:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608923904 00000100:00100000:3.0:1786034613.780882:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608923904 00010000:00010000:3.0:1786034613.780917:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af40979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75891b expref: 7 pid: 8676 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034613.780964:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 74 00000100:00100000:3.0:1786034613.780972:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457476a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2362:x1872792608923904:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034613.780993:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034613.781022:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af40979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75891b expref: 7 pid: 8676 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.781222:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af40979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75891b expref: 7 pid: 8676 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.781246:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e385422/0x490975051af40979 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75891b expref: 7 pid: 8676 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.781260:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034613.781265:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034613.781273:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 6 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.781282:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 6 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034613.781322:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 6 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034613.781335:0:5848:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5848:1872792636183552:192.168.203.56@tcp:105: 00000100:00100000:3.0:1786034613.781434:0:5848:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560a95840 going to sleep for 11 seconds 00000100:00100000:3.0:1786034613.792867:0:5848:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5848:1872792636183552:192.168.203.56@tcp:105: 00010000:00010000:3.0:1786034613.792893:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034613.792943:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457476a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2362:x1872792608923904:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 11972us (12188us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034613.792954:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 74 00000100:00100000:2.0:1786034613.804598:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034613.804757:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608924160 00000100:00100000:1.0:1786034613.804765:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608924160 00000100:00100000:1.0:1786034613.804855:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 55 00000100:00100000:1.0:1786034613.804864:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457476a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+38:11581:x1872792608924160:12345-192.168.203.56@tcp:35:bash.0 00000001:00080000:1.0:1786034613.805155:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967483 00000100:00100000:1.0:1786034613.805486:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457476a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+40:11581:x1872792608924160:12345-192.168.203.56@tcp:35:bash.0 Request processed in 623us (894us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1786034613.805495:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 55 00000020:00080000:1.0:1786034613.805499:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786034613.809782:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786034613.809858:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636183680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034613.809952:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034613.810205:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636183680 00000100:00100000:0.0:1786034613.810213:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636183680 00000100:00100000:0.0:1786034613.810276:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1786034613.810293:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636183680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034613.810326:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034613.810367:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636183680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034613.810374:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1786034613.810556:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786034613.810867:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636183680:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786034613.936116:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034614.107165:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034614.107314:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608924288 00000100:00100000:0.0:1786034614.107323:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608924288 00000100:00100000:0.0:1786034614.107384:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 200 00000100:00100000:0.0:1786034614.107394:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+40:11597:x1872792608924288:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034614.107433:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034614.107494:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40987 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758929 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.107567:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af4098e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.107581:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af4098e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.107592:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af4098e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034614.107646:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1786034614.107650:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034614.107673:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af4098e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.107695:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af40987 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758929 expref: 42 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.107710:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af4098e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758929 expref: 41 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.107717:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034614.107720:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034614.107723:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9e00, rc 0) 00000100:00100000:0.0:1786034614.107777:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+41:11597:x1872792608924288:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 385us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034614.107783:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 200 00000100:00100000:2.0:1786034614.131353:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034614.131440:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608924544 00000100:00100000:3.0:1786034614.131448:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608924544 00000100:00100000:3.0:1786034614.131501:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 201 00000100:00100000:3.0:1786034614.131518:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+41:11597:x1872792608924544:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034614.131534:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034614.131553:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af40995 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758930 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.131641:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af4099c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.131652:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af4099c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.131662:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af4099c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034614.131671:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1786034614.131778:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af40995 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758930 expref: 44 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.131794:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af4099c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758930 expref: 43 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.131813:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9645821d2e00) 00010000:00010000:3.0:1786034614.131815:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034614.131819:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562313000, rc 0) 00000100:00100000:3.0:1786034614.131910:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+43:11597:x1872792608924544:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 394us (567us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1786034614.131917:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 201 00000100:00100000:2.0:1786034614.143770:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034614.143868:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608924672 00000100:00100000:0.0:1786034614.143878:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608924672 00000100:00100000:0.0:1786034614.143944:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00100000:0.0:1786034614.143954:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454acec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+43:2365:x1872792608924672:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034614.143983:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034614.144008:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af4099c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758930 expref: 43 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.144035:0:7671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9645821d2e00) 00010000:00010000:0.0:1786034614.144040:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034614.144092:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454acec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+42:2365:x1872792608924672:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 140us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034614.144100:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00100000:2.0:1786034614.156723:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034614.156808:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608924928 00000100:00100000:0.0:1786034614.156817:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608924928 00000100:00100000:0.0:1786034614.156897:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 202 00000100:00100000:0.0:1786034614.156906:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457476bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+42:11597:x1872792608924928:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034614.156927:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034614.156946:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af409aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758937 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.157052:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.157065:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.157075:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034614.157100:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1786034614.157221:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af409aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758937 expref: 45 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.157239:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758937 expref: 44 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.157246:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9645821d2e00) 00010000:00010000:0.0:1786034614.157248:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786034614.157251:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8600, rc 0) 00000100:00100000:0.0:1786034614.157311:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457476bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+44:11597:x1872792608924928:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 406us (596us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1786034614.157317:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 202 00000100:00100000:2.0:1786034614.174842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034614.174920:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608925056 00000100:00100000:1.0:1786034614.174928:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608925056 00000100:00100000:1.0:1786034614.174983:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 61 00000100:00100000:1.0:1786034614.174992:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964559c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+6:2363:x1872792608925056:12345-192.168.203.56@tcp:1:lfs.0 00010000:00010000:1.0:1786034614.175031:0:8676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057b94378/0x490975051af409bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.175050:0:8676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 6 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.175059:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786034614.175063:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786034614.175067:0:8676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057b94378/0x490975051af409bf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.175098:0:8676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 6 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.175124:0:8676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 6 pid: 6721 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034614.175139:0:8676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1872792636183808:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034614.175223:0:8676:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455d0a9900 going to sleep for 11 seconds 00000100:00100000:1.0:1786034614.178434:0:8676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1872792636183808:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034614.178463:0:8676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000057b94378/0x490975051af409bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034614.182604:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034614.183019:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608925184 00000100:00100000:1.0:1786034614.183028:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608925184 00002000:00100000:1.0:1786034614.183076:0:6727:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff96457476b800 x1872792608925184/t0(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:585/0 lens 504/0 e 0 to 0 dl 1786034625 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786034614.183088:0:6727:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96457476b800 with x1872792608925184 ext(0->8) 00010000:00010000:1.0:1786034614.183098:0:6727:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 7 pid: 6721 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.183115:0:6727:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 7 pid: 6721 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786034614.183123:0:6727:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96457476b800 00000100:00100000:1.0:1786034614.183156:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 3 00000100:00100000:1.0:1786034614.183174:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2363:x1872792608925184:12345-192.168.203.56@tcp:4:lfs.0 00000100:00100000:1.0:1786034614.183640:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2363:x1872792608925184:12345-192.168.203.56@tcp:4:lfs.0 Request processed in 475us (1042us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1786034614.183648:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 3 00002000:00100000:1.0:1786034614.183654:0:6727:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff96457476b800 x1872792608925184/t4294967308(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:585/0 lens 504/448 e 0 to 0 dl 1786034625 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786034614.183663:0:6727:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96457476b800 with x1872792608925184 ext(0->8) 00010000:00010000:1.0:1786034614.183668:0:6727:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 9 pid: 6721 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.183680:0:6727:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 9 pid: 6721 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786034614.183688:0:6727:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff96457476b800 00000100:00100000:2.0:1786034614.192346:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034614.193082:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608925312 00000100:00100000:1.0:1786034614.193092:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608925312 00010000:00010000:1.0:1786034614.193132:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 9 pid: 6721 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034614.193181:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 75 00000100:00100000:1.0:1786034614.193191:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2364:x1872792608925312:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034614.193205:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786034614.193222:0:5846:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1786034614.193224:0:5846:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1786034613 00002000:00010000:1.0:1786034614.193227:0:5846:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1786034613 00002000:00010000:1.0:1786034614.193229:0:5846:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1786034613 00010000:00010000:1.0:1786034614.193248:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 9 pid: 6721 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.193261:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 9 pid: 6721 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.193295:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034c50b5e/0x490975051af40980 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758922 expref: 9 pid: 6721 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.193312:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786034614.193317:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786034614.193322:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000057b94378/0x490975051af409bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.193331:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057b94378/0x490975051af409bf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.193363:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786034614.193570:0:8676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000057b94378/0x490975051af409bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034614.193580:0:8676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057b94378/0x490975051af409bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034614.193603:0:8676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057b94378/0x490975051af409bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034614.193618:0:8676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057b94378/0x490975051af409bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034614.193626:0:8676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057b94378/0x490975051af409bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034614.193634:0:8676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01c00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:2.0:1786034614.193638:0:8676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057b94378/0x490975051af409bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034614.193646:0:8676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057b94378/0x490975051af409bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034614.193658:0:8676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057b94378/0x490975051af409bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034614.193665:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057b94378/0x490975051af409bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034614.193726:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2364:x1872792608925312:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 535us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034614.193734:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 75 00000100:00100000:2.0:1786034614.197958:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964559c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2363:x1872792608925056:12345-192.168.203.56@tcp:1:lfs.0 Request processed in 22957us (23135us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034614.197970:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 61 00000100:00100000:2.0:1786034614.212343:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034614.215238:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608925568 00000100:00100000:3.0:1786034614.215251:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608925568 00000100:00100000:3.0:1786034614.215365:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 56 00000100:00100000:3.0:1786034614.215373:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+44:11597:x1872792608925568:12345-192.168.203.56@tcp:35:lfs.0 00000004:00010000:3.0:1786034614.215429:0:5865:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758937 expref: 44 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786034614.215670:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1786034614.215718:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1786034614.216075:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1786034614.216123:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.216140:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4096b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758914 expref: 48 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.216149:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.216190:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4096b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758914 expref: 48 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.216221:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4096b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758914 expref: 48 pid: 5863 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034614.216235:0:5865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5865:1872792636183936:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034614.216320:0:5865:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1786034614.221191:0:5865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5865:1872792636183936:192.168.203.56@tcp:104: 00010000:00010000:0.0:1786034614.221223:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034614.221921:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034614.222178:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608925696 00000100:00100000:3.0:1786034614.222186:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608925696 00010000:00010000:3.0:1786034614.222220:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4096b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758914 expref: 49 pid: 5863 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034614.222249:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 76 00000100:00100000:3.0:1786034614.222258:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+49:2362:x1872792608925696:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034614.222271:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034614.222278:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4096b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758914 expref: 49 pid: 5863 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.222305:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4096b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758914 expref: 49 pid: 5863 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.222328:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9400/0x490975051af4096b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758914 expref: 49 pid: 5863 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.222344:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9645821d2e00) 00010000:00010000:3.0:1786034614.222348:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.222374:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.222380:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.222413:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034614.222455:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+48:2362:x1872792608925696:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 198us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034614.222463:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 76 00010000:00010000:2.0:1786034614.222609:0:5865:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034614.222624:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786034614.222731:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1786034614.222953:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1786034614.223065:0:5865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574768380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1872792636184064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786034614.223154:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034614.223188:0:5865:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a943780 going to sleep for 11 seconds 00000100:00100000:3.0:1786034614.223623:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636184064 00000100:00100000:3.0:1786034614.223629:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636184064 00000100:00100000:3.0:1786034614.223669:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786034614.223676:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457476a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5865:x1872792636184064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786034614.223745:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457476a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5865:x1872792636184064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 69us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034614.223751:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786034614.223789:0:5865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574768380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1872792636184064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1786034614.226345:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1786034614.226422:0:5865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1872792636184192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786034614.226469:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034614.226498:0:5865:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a943000 going to sleep for 11 seconds 00000100:00100000:2.0:1786034614.227071:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636184192 00000100:00100000:2.0:1786034614.227078:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636184192 00000100:00100000:2.0:1786034614.227122:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786034614.227130:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5865:x1872792636184192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786034614.227306:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5865:x1872792636184192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 175us (834us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1786034614.227313:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786034614.227566:0:5865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1872792636184192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1786034614.227617:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1786034614.227656:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.227679:0:5865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.227687:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.227693:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034614.227698:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.227706:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.227721:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9645821d2e00) 00010000:00010000:3.0:1786034614.227724:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1786034614.227728:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.227735:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409c6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786034614.227922:0:5865:0:(mdd_object.c:4291:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1786034614.228637:0:5865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1786034614.228648:0:5865:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 450436824419ns, next at 451436822531ns, rc = 0 00000001:00080000:3.0:1786034614.228655:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1786034614.228686:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9645821d2e00) 00010000:00010000:3.0:1786034614.228689:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786034614.228695:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758937 expref: 52 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034614.228858:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+51:11597:x1872792608925568:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 13484us (16521us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1786034614.228867:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 56 00000020:00080000:3.0:1786034614.228871:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1786034614.241069:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034614.241577:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608925824 00000100:00100000:3.0:1786034614.241585:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608925824 00000100:00100000:3.0:1786034614.241637:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 203 00000100:00100000:3.0:1786034614.241647:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+51:11597:x1872792608925824:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034614.241670:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034614.241693:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af409cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75893e expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.241749:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af409cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75893e expref: 52 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.241763:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af409cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75893e expref: 52 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.241780:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034614.241782:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786034614.241786:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312a00, rc 0) 00000100:00100000:3.0:1786034614.241854:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+52:11597:x1872792608925824:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 209us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034614.241860:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 203 00000100:00100000:2.0:1786034614.257957:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034614.258025:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608926080 00000100:00100000:1.0:1786034614.258035:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608926080 00000100:00100000:1.0:1786034614.258086:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 57 00000100:00100000:1.0:1786034614.258096:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457476ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+52:11597:x1872792608926080:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:1.0:1786034614.258307:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457476ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+53:11597:x1872792608926080:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 212us (356us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1786034614.258323:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 57 00000100:00100000:2.0:1786034614.449955:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034614.450048:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608926208 00000100:00100000:0.0:1786034614.450057:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608926208 00000100:00100000:0.0:1786034614.450109:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 204 00000100:00100000:0.0:1786034614.450120:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457476a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+53:11607:x1872792608926208:12345-192.168.203.56@tcp:34:lfs.0 00010000:00010000:0.0:1786034614.450206:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af409d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450223:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af409d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450250:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af409d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450265:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af409db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450272:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af409db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450279:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af409db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450389:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450398:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450405:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786034614.450444:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450455:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af409d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450462:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af409d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450468:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af409d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450485:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034614.450489:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af409d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450496:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af409d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450521:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034614.450524:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034614.450529:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af409d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450535:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8400/0x490975051af409d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450548:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af409db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450554:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af409db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450560:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af409db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450565:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034614.450567:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af409db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450573:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af409db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450592:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9645821d2f00) 00010000:00010000:0.0:1786034614.450594:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034614.450598:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af409db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450603:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af409db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450616:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450622:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450627:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450632:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034614.450635:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450641:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450649:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:0.0:1786034614.450651:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034614.450654:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.450659:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af409e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034614.450741:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457476a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+53:11607:x1872792608926208:12345-192.168.203.56@tcp:34:lfs.0 Request processed in 622us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034614.450749:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 204 00000100:00100000:2.0:1786034614.551927:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034614.552020:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608926464 00000100:00100000:3.0:1786034614.552029:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608926464 00000100:00100000:3.0:1786034614.552102:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 205 00000100:00100000:3.0:1786034614.552112:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+53:11610:x1872792608926464:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034614.552131:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034614.552151:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758945 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552229:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af409f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552242:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af409f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552253:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af409f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552269:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af409f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552276:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af409f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552291:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af409f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552407:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af409fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552416:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af409fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552423:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af409fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034614.552443:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1786034614.552545:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af409f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552552:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af409f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552558:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af409f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552564:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034614.552568:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af409f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552575:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af409f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552585:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:3.0:1786034614.552588:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034614.552591:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af409f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552598:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af409f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552609:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af409f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552615:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af409f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552631:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af409f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552636:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034614.552638:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af409f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552644:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af409f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552651:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96454a119400) 00010000:00010000:3.0:1786034614.552653:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034614.552656:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af409f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552661:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af409f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552697:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af409e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758945 expref: 56 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552710:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af409fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758945 expref: 55 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.552718:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034614.552720:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034614.552722:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0800, rc 0) 00000100:00100000:3.0:1786034614.552777:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:11610:x1872792608926464:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 666us (857us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1786034614.552792:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 205 00000100:00100000:2.0:1786034614.558661:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034614.559123:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608926592 00000100:00100000:3.0:1786034614.559132:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608926592 00000100:00100000:3.0:1786034614.559196:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 206 00000100:00100000:3.0:1786034614.559206:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:11610:x1872792608926592:12345-192.168.203.56@tcp:54:lfs.0 00010000:00010000:3.0:1786034614.559264:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40a0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.559288:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.559300:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.559322:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.559327:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40a0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.559333:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.559338:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034614.559342:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.559347:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40a0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.559356:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034614.559367:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786034614.559371:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40a0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.559377:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40a0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034614.559448:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:11610:x1872792608926592:12345-192.168.203.56@tcp:54:lfs.0 Request processed in 243us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034614.559454:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 206 00000100:00100000:2.0:1786034614.568916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034614.569003:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608926848 00000100:00100000:1.0:1786034614.569013:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608926848 00000100:00100000:1.0:1786034614.569073:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 58 00000100:00100000:1.0:1786034614.569083:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+55:11610:x1872792608926848:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:1.0:1786034614.569318:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+56:11610:x1872792608926848:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 237us (409us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1786034614.569325:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 58 00000100:00100000:2.0:1786034614.718654:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034614.718732:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608927104 00000100:00100000:3.0:1786034614.718740:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608927104 00000100:00100000:3.0:1786034614.718793:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 207 00000100:00100000:3.0:1786034614.718802:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+56:11620:x1872792608927104:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:3.0:1786034614.718875:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034614.718878:0:6743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786034614.718904:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af4098e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758929 expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.718922:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:3.0:1786034614.718926:0:6743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034614.718938:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40a13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75894c expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.719033:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.719047:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.719074:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034614.719086:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1786034614.719376:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40a13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75894c expref: 58 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.719391:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75894c expref: 57 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.719399:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034614.719402:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034614.719405:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0e00, rc 0) 00000100:00100000:3.0:1786034614.719506:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+57:11620:x1872792608927104:12345-192.168.203.56@tcp:101:bash.0 Request processed in 697us (852us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1786034614.719513:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 207 00000100:00100000:2.0:1786034614.725966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034614.726009:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034614.726114:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608927488 00000100:00100000:0.0:1786034614.726123:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608927488 00000100:00100000:0.0:1786034614.726178:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 208 00000100:00100000:0.0:1786034614.726187:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964548a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+57:11620:x1872792608927488:12345-192.168.203.56@tcp:36:bash.0 00010000:00010000:0.0:1786034614.726235:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034614.726258:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af409fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758945 expref: 57 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.726274:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:0.0:1786034614.726288:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786034614.726460:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.726474:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75894c expref: 57 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.726483:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.726520:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75894c expref: 57 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.726532:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75894c expref: 57 pid: 6743 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034614.726562:0:5861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dff800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636184320:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034614.726634:0:5861:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455110e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034614.727118:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608927232 00000100:00100000:3.0:1786034614.727123:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608927232 00010000:00010000:3.0:1786034614.727142:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a1a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75894c expref: 58 pid: 6743 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034614.727180:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 77 00000100:00100000:3.0:1786034614.727187:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+58:2364:x1872792608927232:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034614.727196:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034614.727201:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a1a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75894c expref: 58 pid: 6743 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.727224:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75894c expref: 58 pid: 6743 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.727236:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034614.727240:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.727248:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.727254:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.727266:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034614.727304:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+58:2364:x1872792608927232:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 117us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034614.727311:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 77 00010000:00010000:0.0:1786034614.729864:0:5861:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.56@tcp) returned -22 from blocking AST (req@000000000e3458f6 x1872792636184320) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a1a lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75894c expref: 57 pid: 6743 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.729883:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75894c expref: 57 pid: 6743 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034614.729899:0:5861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dff800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636184320:192.168.203.56@tcp:104: 00010000:00010000:0.0:1786034614.729917:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:0.0:1786034614.729923:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.729930:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034614.729935:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786034614.730043:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1786034614.730086:0:5861:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000bfa8b962 reply state 000000004bd00468 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034614.730095:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786034614.730325:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964548a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+58:11620:x1872792608927488:12345-192.168.203.56@tcp:36:bash.0 Request processed in 4138us (4314us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1786034614.730345:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 208 00000020:00080000:0.0:1786034614.730350:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786034614.743790:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034614.743875:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608927616 00000100:00100000:1.0:1786034614.743885:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608927616 00000100:00100000:1.0:1786034614.743938:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 209 00000100:00100000:1.0:1786034614.743947:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+58:11620:x1872792608927616:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:1.0:1786034614.743968:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034614.743994:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758953 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.744095:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.744109:0:6743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.744117:0:6743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.744134:0:6743:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.744154:0:6743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.747615:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.747630:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.747636:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.747641:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034614.747645:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.747668:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.747683:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034614.747686:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034614.747689:0:3293:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.747696:0:3293:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.747702:0:3293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.747800:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.747806:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40a28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.753602:0:6743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.753618:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034614.753674:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1786034614.753677:0:6743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786034614.753694:0:6743:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.753728:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758953 expref: 59 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.753746:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758953 expref: 58 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.753754:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:1.0:1786034614.753756:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034614.753759:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01200, rc 0) 00000100:00100000:1.0:1786034614.753914:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+58:11620:x1872792608927616:12345-192.168.203.56@tcp:101:bash.0 Request processed in 9967us (10131us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034614.753922:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 209 00000100:00100000:2.0:1786034614.763467:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034614.763607:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608927872 00000100:00100000:1.0:1786034614.763615:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608927872 00000100:00100000:1.0:1786034614.763663:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 59 00000100:00100000:1.0:1786034614.763682:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+58:11620:x1872792608927872:12345-192.168.203.56@tcp:35:bash.0 00000100:00100000:1.0:1786034614.763913:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+59:11620:x1872792608927872:12345-192.168.203.56@tcp:35:bash.0 Request processed in 231us (455us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1786034614.763920:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 59 00000100:00100000:2.0:1786034614.875461:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034614.875553:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608928000 00000100:00100000:1.0:1786034614.875561:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608928000 00000100:00100000:1.0:1786034614.875620:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 210 00000100:00100000:1.0:1786034614.875629:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+59:11626:x1872792608928000:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:1.0:1786034614.875650:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034614.875668:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75895a expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.875725:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40a44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.875738:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.875750:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034614.875801:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1786034614.875804:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786034614.875864:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.875888:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75895a expref: 61 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.875923:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40a44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75895a expref: 60 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.875932:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:1.0:1786034614.875944:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786034614.875948:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00a00, rc 0) 00000100:00100000:1.0:1786034614.876009:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+60:11626:x1872792608928000:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 381us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034614.876016:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 210 00000100:00100000:0.0:1786034614.884263:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034614.888242:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608928128 00000100:00100000:2.0:1786034614.888270:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608928128 00000100:00100000:3.0:1786034614.888596:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 211 00000100:00100000:3.0:1786034614.888606:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+60:11626:x1872792608928128:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034614.888910:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034614.888931:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40a4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758961 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.889292:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40a52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.889306:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40a52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.889325:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40a52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.889340:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.889347:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.889353:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.889910:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.889920:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.889926:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034614.889956:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1786034614.889960:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786034614.889976:0:5863:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890220:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890229:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40a52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890244:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40a52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890250:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40a52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890256:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034614.890259:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40a52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890266:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40a52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890285:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:3.0:1786034614.890289:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034614.890293:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40a52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890299:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40a52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890311:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890317:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890323:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890327:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034614.890335:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890340:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890348:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96454a119400) 00010000:00010000:3.0:1786034614.890350:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034614.890352:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890358:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40a59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890385:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40a4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758961 expref: 62 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890397:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758961 expref: 61 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.890405:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034614.890407:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034614.890409:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0800, rc 0) 00000100:00100000:3.0:1786034614.891020:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:11626:x1872792608928128:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 2411us (6762us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034614.891028:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 211 00000100:00100000:2.0:1786034614.908602:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034614.910876:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034614.911247:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608928512 00000100:00100000:3.0:1786034614.911255:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608928512 00000100:00100000:3.0:1786034614.911322:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:3.0:1786034614.911331:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:2364:x1872792608928512:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034614.911357:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034614.911382:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758961 expref: 61 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.911409:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034614.911414:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034614.911467:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+60:2364:x1872792608928512:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 138us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034614.911475:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:1.0:1786034614.913697:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608928384 00000100:00100000:1.0:1786034614.913707:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608928384 00000100:00100000:1.0:1786034614.913813:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 212 00000100:00100000:1.0:1786034614.913841:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+60:11626:x1872792608928384:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:1.0:1786034614.913859:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034614.913878:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758968 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.913974:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.914001:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758953 expref: 61 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.914010:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.914042:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758953 expref: 61 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.914064:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758953 expref: 61 pid: 6743 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034614.914078:0:5862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636184448:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034614.915632:0:5862:0:(client.c:2702:ptlrpc_set_wait()) set ffff96455d0a9900 going to sleep for 11 seconds 00000100:00100000:1.0:1786034614.918749:0:5862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636184448:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034614.918774:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034614.919348:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034614.919410:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608928640 00000100:00100000:3.0:1786034614.919416:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608928640 00010000:00010000:3.0:1786034614.919446:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758953 expref: 62 pid: 6743 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034614.919481:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 78 00000100:00100000:3.0:1786034614.919492:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+62:2362:x1872792608928640:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034614.919511:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034614.919518:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758953 expref: 62 pid: 6743 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.919531:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758953 expref: 62 pid: 6743 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.919551:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40a36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758953 expref: 62 pid: 6743 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.919566:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034614.919581:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.919590:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.919598:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.919625:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034614.919679:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:2362:x1872792608928640:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 188us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034614.919686:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 78 00010000:00010000:1.0:1786034614.919785:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.919793:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034614.919809:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1786034614.919983:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758968 expref: 62 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.919999:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758968 expref: 61 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.920006:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:1.0:1786034614.920009:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786034614.920011:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01000, rc 0) 00000100:00100000:1.0:1786034614.920052:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:11626:x1872792608928384:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 6231us (11457us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1786034614.920067:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 212 00000100:00100000:2.0:1786034614.923677:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034614.923745:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608928896 00000100:00100000:3.0:1786034614.923753:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608928896 00000100:00100000:3.0:1786034614.923805:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 17 00000100:00100000:3.0:1786034614.923814:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551935500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:11626:x1872792608928896:12345-192.168.203.56@tcp:103:lfs.0 00010000:00010000:3.0:1786034614.923863:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034614.923886:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af409cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75893e expref: 61 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.923903:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034614.923908:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034614.923956:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551935500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+60:11626:x1872792608928896:12345-192.168.203.56@tcp:103:lfs.0 Request processed in 142us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034614.923963:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 17 00000100:00100000:0.0:1786034614.926888:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034614.926934:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608929024 00000100:00100000:1.0:1786034614.926943:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608929024 00000100:00100000:1.0:1786034614.926998:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 213 00000100:00100000:1.0:1786034614.927007:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+60:11626:x1872792608929024:12345-192.168.203.56@tcp:58:lfs.0 00010000:00010000:1.0:1786034614.927107:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40a7c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.927123:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40a7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034614.927135:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40a7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786034614.927747:0:6743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1786034614.927839:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+60:11626:x1872792608929024:12345-192.168.203.56@tcp:58:lfs.0 Request processed in 814us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034614.927848:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 213 00000100:00100000:0.0:1786034614.941066:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034614.941354:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608929152 00000100:00100000:3.0:1786034614.941362:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608929152 00000100:00100000:3.0:1786034614.941462:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 214 00000100:00100000:3.0:1786034614.941484:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+60:11626:x1872792608929152:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034614.941514:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034614.941535:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75896f expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.941590:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40a7c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.941602:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a83 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75896f expref: 61 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.941619:0:5861:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40a7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.941630:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a83 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75896f expref: 61 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.941642:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034614.941645:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786034614.941649:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a83 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75896f expref: 61 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034614.941656:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0800, rc 0) 00000100:00100000:3.0:1786034614.941710:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:11626:x1872792608929152:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 229us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034614.941717:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 214 00010000:00010000:2.0:1786034614.964221:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786034615.152320:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786034615.152329:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786034615.152383:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1786034615.152390:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786034615.152520:0:11732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645747b7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11732:1872792636184576:192.168.203.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786034615.152612:0:11732:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a943780 going to sleep for 11 seconds 00000100:00100000:0.0:1786034615.160665:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034615.161473:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608929280 00000100:00100000:1.0:1786034615.161482:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608929280 00000100:00100000:1.0:1786034615.161562:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 215 00000100:00100000:1.0:1786034615.161575:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+62:11627:x1872792608929280:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786034615.161603:0:5863:0:(mdt_handler.c:8007:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786034615.161694:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+62:11627:x1872792608929280:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 Request processed in 123us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034615.161702:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 215 00000100:00080000:2.0:1786034615.161889:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034615.167877:0:11732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645747b7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11732:1872792636184576:192.168.203.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786034615.171395:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034615.172017:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608929408 00000100:00100000:1.0:1786034615.172038:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608929408 00000100:00100000:1.0:1786034615.172091:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 216 00000100:00100000:1.0:1786034615.172100:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:11627:x1872792608929408:12345-192.168.203.56@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1786034615.172179:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a8a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172195:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172208:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172222:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40a91 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172229:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40a91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172235:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40a91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172257:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40a98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172266:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172273:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034615.172315:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1786034615.172319:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786034615.172337:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172348:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172355:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a8a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172363:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a8a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172369:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034615.172373:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a8a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172381:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a8a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172392:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9645521d1700) 00010000:00010000:1.0:1786034615.172395:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034615.172399:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a8a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172405:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01a00/0x490975051af40a8a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172417:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40a91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172432:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40a91 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172439:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40a91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172450:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034615.172461:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40a91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172468:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40a91 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172476:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9645521d1f00) 00010000:00010000:1.0:1786034615.172479:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034615.172482:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40a91 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172488:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40a91 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172504:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172510:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40a98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172516:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172522:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034615.172524:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172530:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40a98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172547:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:1.0:1786034615.172549:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034615.172552:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40a98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.172558:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40a98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034615.173578:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:11627:x1872792608929408:12345-192.168.203.56@tcp:34:lhsmtool_posix.0 Request processed in 1473us (2186us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034615.173589:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 216 00000100:00100000:0.0:1786034615.207021:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034615.207224:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608929664 00000100:00100000:1.0:1786034615.207233:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608929664 00000100:00100000:1.0:1786034615.207299:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 217 00000100:00100000:1.0:1786034615.207309:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+61:11627:x1872792608929664:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786034615.207328:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034615.207348:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40a9f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758976 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.207452:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40aa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.207466:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.207478:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034615.207490:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1786034615.207599:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.207606:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40aa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.207612:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.207618:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034615.207622:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.207629:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.207640:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:1.0:1786034615.207643:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786034615.207647:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40aa6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.207652:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40aa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.207689:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40a9f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758976 expref: 63 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.207699:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9645521d1700) 00010000:00010000:1.0:1786034615.207701:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786034615.207704:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40a9f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758976 expref: 63 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.207734:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00800, rc 0) 00000100:00100000:1.0:1786034615.207793:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+62:11627:x1872792608929664:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 485us (779us total) trans 4294967504 rc 301/301 00000100:00100000:1.0:1786034615.207800:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 217 00000100:00100000:0.0:1786034615.223576:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034615.230065:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608929792 00000100:00100000:1.0:1786034615.230079:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608929792 00000100:00100000:2.0:1786034615.237075:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 218 00000100:00100000:2.0:1786034615.237090:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+62:11627:x1872792608929792:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786034615.237127:0:5862:0:(mdt_handler.c:8007:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786034615.237236:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+62:11627:x1872792608929792:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 Request processed in 149us (13667us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034615.237243:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 218 00000100:00100000:0.0:1786034615.245969:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034615.246407:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608930048 00000100:00100000:1.0:1786034615.246416:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608930048 00000100:00100000:1.0:1786034615.246480:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 219 00000100:00100000:1.0:1786034615.246490:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+62:11627:x1872792608930048:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786034615.246509:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034615.246512:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786034615.246538:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40a44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75895a expref: 62 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.246554:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:1.0:1786034615.246559:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786034615.246571:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40ab4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75897d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786034615.247123:0:5863:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1786034615.247313:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40abb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.247325:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.247352:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.247396:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40ab4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75897d expref: 64 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.247410:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40abb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75897d expref: 63 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.247417:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9645521d1f00) 00010000:00010000:1.0:1786034615.247420:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034615.248142:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01c00, rc 0) 00000100:00100000:0.0:1786034615.248306:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+63:11627:x1872792608930048:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 1816us (2343us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1786034615.248315:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 219 00000100:00100000:0.0:1786034615.266925:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034615.267045:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608930304 00000100:00100000:3.0:1786034615.267054:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608930304 00000100:00100000:2.0:1786034615.267163:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 220 00000100:00100000:2.0:1786034615.267174:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+63:11627:x1872792608930304:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786034615.267230:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034615.267257:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40abb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75897d expref: 63 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267284:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9645521d1f00) 00010000:00010000:2.0:1786034615.267298:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786034615.267318:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af40ac9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267332:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af40ac9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267340:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af40ac9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267402:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40ad0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6060cb20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267411:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6060cb20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267418:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6060cb20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267497:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af40ac9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267505:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af40ac9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267512:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af40ac9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267518:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034615.267522:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af40ac9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267529:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af40ac9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267537:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:2.0:1786034615.267540:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034615.267544:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af40ac9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267550:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af40ac9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267566:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6060cb20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267572:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40ad0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6060cb20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267578:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40ad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6060cb20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267583:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034615.267587:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40ad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6060cb20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267592:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40ad0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6060cb20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267600:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6060cb20 (ffff96455a530900) 00010000:00010000:2.0:1786034615.267603:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034615.267606:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40ad0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6060cb20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.267611:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40ad0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6060cb20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034615.267686:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+62:11627:x1872792608930304:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 513us (770us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786034615.267693:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 220 00000100:00100000:3.0:1786034615.270861:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034615.270924:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608930432 00000100:00100000:0.0:1786034615.270944:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608930432 00000100:00100000:0.0:1786034615.270996:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 221 00000100:00100000:0.0:1786034615.271005:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+62:11627:x1872792608930432:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786034615.271021:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034615.271042:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40ad7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758984 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.271076:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.271088:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.271109:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.271193:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40ad7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758984 expref: 64 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.271210:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758984 expref: 63 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.271218:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9645821d2f00) 00010000:00010000:0.0:1786034615.271221:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786034615.271225:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8200, rc 0) 00000100:00100000:0.0:1786034615.271325:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+63:11627:x1872792608930432:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 321us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034615.271333:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 221 00000100:00100000:2.0:1786034615.293858:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034615.293948:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608930688 00000100:00100000:0.0:1786034615.293957:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608930688 00000100:00100000:0.0:1786034615.294015:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 222 00000100:00100000:0.0:1786034615.294025:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+63:11627:x1872792608930688:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786034615.294106:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40ae5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.294122:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.294134:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786034615.294385:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1786034615.294394:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 451502569683ns, next at 452502567413ns, rc = 0 00000004:00010000:0.0:1786034615.294480:0:5861:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000000a9a8757 reply state 000000002ba3876b transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034615.294490:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786034615.294584:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+65:11627:x1872792608930688:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 559us (767us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1786034615.294591:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 222 00010000:00010000:3.0:1786034615.313156:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.313172:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40ae5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.313180:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.313186:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034615.313191:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.313198:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40ae5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.313214:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9645821d2f00) 00010000:00010000:3.0:1786034615.313217:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786034615.313222:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40ae5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.313228:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af40ae5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034615.313306:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034615.314520:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608930816 00000100:00100000:2.0:1786034615.314529:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608930816 00000100:00100000:2.0:1786034615.314591:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 223 00000100:00100000:2.0:1786034615.314600:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+64:11627:x1872792608930816:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786034615.314621:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034615.314638:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40aec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b75898b expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.314691:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75898b expref: 65 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.314704:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75898b expref: 65 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.315502:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9645821d2f00) 00010000:00010000:2.0:1786034615.315506:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786034615.315509:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7c00, rc 0) 00000100:00100000:2.0:1786034615.315570:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+65:11627:x1872792608930816:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 970us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034615.315577:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 223 00000100:00100000:3.0:1786034615.320034:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034615.320146:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608930944 00000100:00100000:2.0:1786034615.320156:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608930944 00000100:00100000:2.0:1786034615.320225:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 62 00000100:00100000:2.0:1786034615.320236:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2363:x1872792608930944:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1786034615.320513:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:2363:x1872792608930944:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 Request processed in 279us (487us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1786034615.320521:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 62 00000100:00080000:3.0:1786034615.320688:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786034615.338355:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034615.338448:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608931200 00000100:00100000:1.0:1786034615.338457:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608931200 00000100:00100000:1.0:1786034615.338518:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 60 00000100:00100000:1.0:1786034615.338528:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+65:11627:x1872792608931200:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786034615.338918:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+66:11627:x1872792608931200:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 Request processed in 390us (569us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1786034615.338926:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 60 00000100:00100000:2.0:1786034615.347256:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034615.347364:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608931456 00000100:00100000:1.0:1786034615.347374:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608931456 00000100:00100000:1.0:1786034615.347436:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 224 00000100:00100000:1.0:1786034615.347447:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+66:11627:x1872792608931456:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786034615.347565:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+66:11627:x1872792608931456:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 118us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034615.347582:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 224 00000100:00100000:3.0:1786034615.350218:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034615.350244:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608931584 00000100:00100000:3.0:1786034615.350250:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608931584 00000100:00100000:3.0:1786034615.350297:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 225 00000100:00100000:3.0:1786034615.350306:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+66:11627:x1872792608931584:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786034615.350323:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034615.350341:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40af3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758992 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.350409:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40afa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.350422:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.350432:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034615.350465:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786034615.350481:0:5863:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.350506:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40af3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758992 expref: 68 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.350522:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758992 expref: 67 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.350541:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9645821d2f00) 00010000:00010000:3.0:1786034615.350544:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786034615.350547:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0e00, rc 0) 00000100:00100000:3.0:1786034615.350587:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+67:11627:x1872792608931584:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 282us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034615.350593:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 225 00000100:00100000:3.0:1786034615.363563:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034615.363679:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608931712 00000100:00100000:1.0:1786034615.363688:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608931712 00000100:00100000:1.0:1786034615.363745:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 63 00000100:00100000:1.0:1786034615.363763:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+10:2362:x1872792608931712:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786034615.363778:0:6720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034615.363797:0:6720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e385422/0x490975051af40b01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758999 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786034615.363846:0:6720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a74b9b6, blocks: 0x1 00010000:00010000:1.0:1786034615.363865:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1786034615.363869:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034615.363879:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e385422/0x490975051af40b01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758999 expref: 11 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.363895:0:6720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e385422/0x490975051af40b01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758999 expref: 11 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.363908:0:6720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00800, rc 0) 00000100:00100000:1.0:1786034615.363964:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+11:2362:x1872792608931712:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 211us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034615.363972:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 63 00000100:00100000:0.0:1786034615.399001:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034615.399157:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608931968 00000100:00100000:1.0:1786034615.399166:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608931968 00000100:00100000:1.0:1786034615.399230:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 226 00000100:00100000:1.0:1786034615.399238:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455185bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+67:11627:x1872792608931968:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786034615.399357:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455185bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+67:11627:x1872792608931968:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 119us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034615.399364:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 226 00000100:00100000:3.0:1786034615.402030:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034615.402228:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608932096 00000100:00100000:0.0:1786034615.402236:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608932096 00000100:00100000:0.0:1786034615.402287:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 64 00000100:00100000:0.0:1786034615.402296:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+11:11627:x1872792608932096:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786034615.402310:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034615.402326:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000950c883/0x490975051af40b08 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7589a0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.402353:0:6719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e385422/0x490975051af40b01 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758999 expref: 12 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.402361:0:6719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786034615.402364:0:6719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786034615.402368:0:6719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000950c883/0x490975051af40b08 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a0 expref: 12 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.402410:0:6719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e385422/0x490975051af40b01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758999 expref: 12 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.402422:0:6719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e385422/0x490975051af40b01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758999 expref: 12 pid: 6720 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034615.402487:0:6719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6719:1872792636184704:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034615.402744:0:6719:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cda840 going to sleep for 11 seconds 00000100:00100000:3.0:1786034615.409584:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034615.409852:0:6719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6719:1872792636184704:192.168.203.56@tcp:104: 00010000:00010000:0.0:1786034615.409884:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000950c883/0x490975051af40b08 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a0 expref: 12 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.409903:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8400, rc 0) 00000100:00100000:0.0:1786034615.409960:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+12:11627:x1872792608932096:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 7665us (7936us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034615.409968:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 64 00000100:00100000:2.0:1786034615.417075:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608932224 00000100:00100000:2.0:1786034615.417090:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608932224 00010000:00010000:2.0:1786034615.417135:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e385422/0x490975051af40b01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758999 expref: 12 pid: 6720 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034615.417181:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 79 00000100:00100000:2.0:1786034615.417191:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454acee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+12:2362:x1872792608932224:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034615.417206:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034615.417228:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e385422/0x490975051af40b01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758999 expref: 12 pid: 6720 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.417242:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e385422/0x490975051af40b01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758999 expref: 12 pid: 6720 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.417264:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e385422/0x490975051af40b01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758999 expref: 12 pid: 6720 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.417287:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034615.417292:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034615.417300:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000950c883/0x490975051af40b08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a0 expref: 11 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.417309:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000950c883/0x490975051af40b08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a0 expref: 11 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.417341:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000950c883/0x490975051af40b08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a0 expref: 11 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034615.417363:0:5848:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d69c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5848:1872792636184832:192.168.203.56@tcp:105: 00000100:00100000:2.0:1786034615.417556:0:5848:0:(client.c:2702:ptlrpc_set_wait()) set ffff96456211f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034615.430843:0:5848:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d69c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5848:1872792636184832:192.168.203.56@tcp:105: 00000100:00100000:2.0:1786034615.430844:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00010000:00010000:3.0:1786034615.430865:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034615.430920:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454acee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+11:2362:x1872792608932224:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 13729us (21341us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034615.430931:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 79 00000100:00100000:1.0:1786034615.431327:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608932352 00000100:00100000:1.0:1786034615.431333:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608932352 00002000:00100000:1.0:1786034615.431373:0:6725:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff964574d69180 x1872792608932352/t0(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:586/0 lens 504/0 e 0 to 0 dl 1786034626 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786034615.431382:0:6725:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574d69180 with x1872792608932352 ext(0->12) 00002000:00010000:1.0:1786034615.431387:0:6725:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff964574d69180 00000100:00100000:1.0:1786034615.431526:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 6 00000100:00100000:1.0:1786034615.431535:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+11:2362:x1872792608932352:12345-192.168.203.56@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1786034615.432603:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:2362:x1872792608932352:12345-192.168.203.56@tcp:4:lhsmtool_posix.0 Request processed in 1067us (1788us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1786034615.432611:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 6 00002000:00100000:1.0:1786034615.432618:0:6725:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff964574d69180 x1872792608932352/t4294967320(0) o4->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:586/0 lens 504/448 e 0 to 0 dl 1786034626 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786034615.432627:0:6725:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574d69180 with x1872792608932352 ext(0->12) 00002000:00010000:1.0:1786034615.432631:0:6725:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff964574d69180 00000100:00100000:3.0:1786034615.449368:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034615.449396:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608932480 00000100:00100000:3.0:1786034615.449403:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608932480 00000100:00100000:3.0:1786034615.449461:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 227 00000100:00100000:3.0:1786034615.449472:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+67:11627:x1872792608932480:12345-192.168.203.56@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1786034615.480818:0:6746:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1786034615.481009:0:6746:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1786034615.481022:0:6746:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1786034615.528757:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1786034615.528769:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:1.0:1786034615.528789:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:1.0:1786034615.528798:0:5883:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1786034615.528810:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:1.0:1786034615.528864:0:5883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff964542db19c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1786034615.528869:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9645747bb300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff964542db1300 00000020:00080000:1.0:1786034615.528885:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9645747bbb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96457475b400 00000004:00080000:1.0:1786034615.528914:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1786034615.528927:0:5883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff964558cdfc00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1786034615.528930:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96457dfd4d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff964558cdf240 00000020:00080000:1.0:1786034615.528933:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96457dfd4100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96457dfc3800 00000020:00080000:0.0:1786034615.529759:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1786034615.529943:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1786034615.530015:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636184960:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786034615.530075:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034615.530130:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034615.530136:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636185088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786034615.530157:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034615.530196:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636184960 00000100:00100000:0.0:1786034615.530202:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636184960 00000100:00100000:0.0:1786034615.530272:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636185088 00000100:00100000:0.0:1786034615.530284:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636185088 00000100:00100000:0.0:1786034615.530305:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786034615.530313:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1872792636184960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786034615.530336:0:6720:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1786034615.530359:0:6720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001fe3784/0x490975051af40b0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.530381:0:6720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5539bdf/0x490975051af408d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ff expref: 12 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.530388:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1786034615.530393:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786034615.530396:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001fe3784/0x490975051af40b0f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.530417:0:6720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5539bdf/0x490975051af408d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ff expref: 12 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.530428:0:6720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5539bdf/0x490975051af408d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ff expref: 12 pid: 6721 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034615.530438:0:6720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cdf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6720:1872792636185344:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034615.530498:0:6720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645593f5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786034615.530513:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1786034615.530525:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1872792636185088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786034615.530629:0:6721:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1786034615.530632:0:6721:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1786034614 00002000:00010000:0.0:1786034615.530634:0:6721:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786034615.530636:0:6721:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1786034614 -> 1786034614 00002000:00010000:0.0:1786034615.530638:0:6721:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1786034615.530782:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786034615.530792:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636185216:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786034615.530818:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034615.530850:0:8676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1786034615.530856:0:8676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1786034615.531030:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636185216 00000100:00100000:2.0:1786034615.531034:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636185216 00000100:00100000:2.0:1786034615.531100:0:12516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786034615.531108:0:12516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636185216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786034615.531120:0:12516:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1786034615.531139:0:12516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a74b9b5, atime: 0x6a74b9b5, ctime: 0x6a74b9b5, blocks: 0xb 00010000:00010000:2.0:1786034615.531144:0:12516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000679c241/0x490975051af40b16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.531153:0:12516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1786034615.531156:0:12516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034615.531161:0:12516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000679c241/0x490975051af40b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.531175:0:12516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000679c241/0x490975051af40b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.531195:0:12516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000679c241/0x490975051af40b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.531203:0:12516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000679c241/0x490975051af40b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.531220:0:12516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786034615.531976:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3309:x1872792636185088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1450us (1816us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1786034615.531984:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1786034615.532337:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff964574cc3b80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1786034615.532343:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636185088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786034615.532417:0:12516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3308:x1872792636185216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1310us (1597us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1786034615.532424:0:12516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786034615.532449:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1786034615.532454:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff964574dfd880, transno 4294967307 00000004:00080000:2.0:1786034615.532464:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1786034615.532487:0:3308:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff964574cdc700 x1872792636185216/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786034631 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1786034615.532495:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff964574cdc700/2, rc 0, transno 4294967310 00000100:00100000:2.0:1786034615.532499:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636185216:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1786034615.535076:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786034615.535083:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786034615.540142:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:11627:x1872792608932480:12345-192.168.203.56@tcp:44:lhsmtool_posix.0 Request processed in 90661us (90770us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034615.540157:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 227 00010000:00010000:3.0:1786034615.540210:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034615.540218:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000679c241/0x490975051af40b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.540230:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6c00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:3.0:1786034615.540234:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000679c241/0x490975051af40b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.540244:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000679c241/0x490975051af40b16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.540261:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000679c241/0x490975051af40b16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.540268:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000679c241/0x490975051af40b16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.540298:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034615.540300:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034615.540301:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034615.545443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034615.545558:0:6720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cdf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6720:1872792636185344:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034615.545585:0:6720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000001fe3784/0x490975051af40b0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034615.545707:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608932608 00000100:00100000:3.0:1786034615.545714:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608932608 00010000:00010000:3.0:1786034615.545756:0:7671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5539bdf/0x490975051af408d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ff expref: 13 pid: 6721 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034615.545795:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 80 00000100:00100000:3.0:1786034615.545804:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645747b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+13:2363:x1872792608932608:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034615.545860:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034615.545866:0:7671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5539bdf/0x490975051af408d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ff expref: 13 pid: 6721 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.545878:0:7671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5539bdf/0x490975051af408d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ff expref: 13 pid: 6721 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.545898:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5539bdf/0x490975051af408d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588ff expref: 13 pid: 6721 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.545910:0:7671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786034615.545915:0:7671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786034615.545920:0:7671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001fe3784/0x490975051af40b0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.545930:0:7671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001fe3784/0x490975051af40b0f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.545949:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034615.545992:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645747b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+12:2363:x1872792608932608:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 188us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034615.545999:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 80 00010000:00010000:1.0:1786034615.546150:0:6720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000001fe3784/0x490975051af40b0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.546160:0:6720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001fe3784/0x490975051af40b0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.546170:0:6720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001fe3784/0x490975051af40b0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.546178:0:6720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001fe3784/0x490975051af40b0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.546201:0:6720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786034615.546709:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1872792636184960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16396us (16633us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1786034615.546716:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1786034615.546972:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034615.546979:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001fe3784/0x490975051af40b0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.546999:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8600 already unused, calling callback (ffffffffc1761020) 00010000:00010000:3.0:1786034615.547004:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001fe3784/0x490975051af40b0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.547013:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001fe3784/0x490975051af40b0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.547024:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001fe3784/0x490975051af40b0f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.547030:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001fe3784/0x490975051af40b0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.547046:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034615.547047:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034615.547049:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786034615.547131:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff964574cc0380/2, rc 0, transno 4294967322 00000100:00100000:1.0:1786034615.547137:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636184960:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786034615.560108:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034615.570390:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608932736 00000100:00100000:2.0:1786034615.570403:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608932736 00000100:00100000:3.0:1786034615.571150:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 68 00000100:00100000:3.0:1786034615.571160:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+12:2362:x1872792608932736:12345-192.168.203.56@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1786034615.655625:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1786034615.655645:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:2.0:1786034615.655651:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1786034615.655738:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1786034615.656943:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2362:x1872792608932736:12345-192.168.203.56@tcp:16:lhsmtool_posix.0 Request processed in 85771us (96830us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034615.656954:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 68 00000100:00100000:3.0:1786034615.664164:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034615.664444:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608932992 00000100:00100000:1.0:1786034615.664453:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608932992 00000100:00100000:1.0:1786034615.664509:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 228 00000100:00100000:1.0:1786034615.664517:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:11627:x1872792608932992:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786034615.664563:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034615.664588:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0e00/0x490975051af40afa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758992 expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.664605:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9645821d2f00) 00010000:00010000:1.0:1786034615.664609:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786034615.664635:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.664647:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.664655:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786034615.664921:0:5861:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000013fa4834 reply state 000000003576f277 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034615.664931:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786034615.665023:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:11627:x1872792608932992:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 506us (868us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1786034615.665032:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 228 00010000:00010000:3.0:1786034615.669810:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.669863:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.669870:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.669876:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034615.669880:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.669888:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.669903:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9645821d2f00) 00010000:00010000:3.0:1786034615.669906:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034615.669910:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.669917:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034615.672859:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034615.673357:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608933120 00000100:00100000:0.0:1786034615.673367:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608933120 00000100:00100000:0.0:1786034615.673424:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 69 00000100:00100000:0.0:1786034615.673434:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964549e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2365:x1872792608933120:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1786034615.673669:0:6719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1786034615.673673:0:6719:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1786034614 -> 1786034613 00002000:00010000:0.0:1786034615.673675:0:6719:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1786034613 00002000:00010000:0.0:1786034615.673677:0:6719:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1786034614 -> 1786034613 00002000:00010000:0.0:1786034615.673679:0:6719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1786034615.673772:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964549e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2365:x1872792608933120:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 Request processed in 339us (920us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1786034615.673780:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 69 00000100:00100000:3.0:1786034615.678763:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034615.678874:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608933376 00000100:00100000:0.0:1786034615.678883:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608933376 00000100:00100000:0.0:1786034615.678956:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 229 00000100:00100000:0.0:1786034615.678981:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:11627:x1872792608933376:12345-192.168.203.56@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1786034615.679046:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.679062:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40ade lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758984 expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.679290:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.679326:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758984 expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.679339:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758984 expref: 20 pid: 5862 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034615.679353:0:5862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cdd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636185472:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034615.679643:0:5862:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a9436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034615.682563:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034615.682675:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608933504 00000100:00100000:2.0:1786034615.682683:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608933504 00010000:00010000:2.0:1786034615.682719:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40ade lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758984 expref: 21 pid: 5862 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034615.682757:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 81 00000100:00100000:2.0:1786034615.682766:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:2362:x1872792608933504:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034615.682778:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034615.682791:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40ade lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758984 expref: 21 pid: 5862 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.682803:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758984 expref: 21 pid: 5862 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.682836:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9645821d2f00) 00010000:00010000:2.0:1786034615.682841:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.682848:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.682854:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.682869:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034615.682907:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:2362:x1872792608933504:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 142us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034615.682913:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 81 00010000:00010000:3.0:1786034615.683113:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758984 expref: 20 pid: 5862 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034615.683129:0:5862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cdd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1872792636185472:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034615.683149:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.683700:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.683708:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.683735:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.683741:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.683747:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.683752:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034615.683756:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.683762:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.683772:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9645821d2f00) 00010000:00010000:3.0:1786034615.683774:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786034615.683778:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.683783:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034615.683862:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:11627:x1872792608933376:12345-192.168.203.56@tcp:55:lhsmtool_posix.0 Request processed in 4858us (5067us total) trans 0 rc -22/-22 00000100:00100000:3.0:1786034615.683876:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 229 00000100:00100000:2.0:1786034615.687610:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034615.687710:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608933632 00000100:00100000:1.0:1786034615.687724:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608933632 00000100:00100000:1.0:1786034615.687801:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 70 00000100:00100000:1.0:1786034615.687811:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2365:x1872792608933632:12345-192.168.203.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786034615.687872:0:6720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cc0bf124/0x490975051af40b2b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.687891:0:6720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000950c883/0x490975051af40b08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a0 expref: 8 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.687899:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034615.687904:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786034615.687908:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc0bf124/0x490975051af40b2b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.687939:0:6720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000950c883/0x490975051af40b08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a0 expref: 8 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.687953:0:6720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000950c883/0x490975051af40b08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a0 expref: 8 pid: 6719 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034615.687979:0:6720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6720:1872792636185600:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034615.688390:0:6720:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d58840 going to sleep for 11 seconds 00000100:00100000:2.0:1786034615.692340:0:6720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6720:1872792636185600:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034615.692372:0:6720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cc0bf124/0x490975051af40b2b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034615.694391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034615.694463:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608933760 00000100:00100000:3.0:1786034615.694471:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608933760 00010000:00010000:3.0:1786034615.694515:0:7671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000950c883/0x490975051af40b08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a0 expref: 9 pid: 6719 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034615.694551:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 82 00000100:00100000:3.0:1786034615.694560:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+9:2362:x1872792608933760:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034615.694573:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034615.694593:0:7671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000950c883/0x490975051af40b08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a0 expref: 9 pid: 6719 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.694605:0:7671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000950c883/0x490975051af40b08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a0 expref: 9 pid: 6719 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.694624:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000950c883/0x490975051af40b08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a0 expref: 9 pid: 6719 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.694637:0:7671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786034615.694641:0:7671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786034615.694646:0:7671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc0bf124/0x490975051af40b2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.694655:0:7671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc0bf124/0x490975051af40b2b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.694700:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034615.694747:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2362:x1872792608933760:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 188us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034615.694754:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 82 00010000:00010000:1.0:1786034615.694861:0:6720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cc0bf124/0x490975051af40b2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.694870:0:6720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc0bf124/0x490975051af40b2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.694904:0:6720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cc0bf124/0x490975051af40b2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.694912:0:6720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc0bf124/0x490975051af40b2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.694921:0:6720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc0bf124/0x490975051af40b2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.694929:0:6720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01a00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034615.694933:0:6720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc0bf124/0x490975051af40b2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.694941:0:6720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc0bf124/0x490975051af40b2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.694953:0:6720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc0bf124/0x490975051af40b2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.694962:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc0bf124/0x490975051af40b2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034615.695003:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2365:x1872792608933632:12345-192.168.203.56@tcp:1:lhsmtool_posix.0 Request processed in 7193us (7401us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034615.695010:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 70 00000100:00100000:0.0:1786034615.698609:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034615.698678:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608934016 00000100:00100000:1.0:1786034615.698687:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608934016 00000100:00100000:1.0:1786034615.698737:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 230 00000100:00100000:1.0:1786034615.698747:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:11627:x1872792608934016:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786034615.698819:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.698948:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.698958:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.699806:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.699819:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40aec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75898b expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.699914:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.699948:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75898b expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.699960:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40aec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75898b expref: 20 pid: 5862 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034615.700236:0:5861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636185728:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034615.700373:0:5861:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d58540 going to sleep for 11 seconds 00000100:00100000:0.0:1786034615.705701:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034615.706003:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608934144 00000100:00100000:2.0:1786034615.706012:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608934144 00010000:00010000:2.0:1786034615.706058:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40aec lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75898b expref: 21 pid: 5862 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034615.706266:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 83 00000100:00100000:2.0:1786034615.706284:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:2363:x1872792608934144:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034615.706298:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034615.706305:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40aec lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75898b expref: 21 pid: 5862 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.706320:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40aec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75898b expref: 21 pid: 5862 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.706391:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9645821d2f00) 00010000:00010000:2.0:1786034615.706397:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.706406:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.706414:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.706442:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034615.706616:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:2363:x1872792608934144:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 340us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034615.706624:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 83 00010000:00010000:1.0:1786034615.706948:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af40aec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75898b expref: 20 pid: 5862 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034615.706972:0:5861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636185728:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034615.707419:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.707429:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034615.707435:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786034615.707731:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1786034615.707903:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1786034615.707947:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1786034615.708049:0:5861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574cc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1872792636185856:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1786034615.708153:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034615.710687:0:5861:0:(client.c:2702:ptlrpc_set_wait()) set ffff964580951240 going to sleep for 11 seconds 00000100:00100000:2.0:1786034615.710778:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636185856 00000100:00100000:2.0:1786034615.710785:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636185856 00000100:00100000:2.0:1786034615.710898:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786034615.710908:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5861:x1872792636185856:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1786034615.711014:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5861:x1872792636185856:12345-0@lo:1000:mdt00_000.0 Request processed in 108us (2861us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034615.711021:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786034615.711399:0:5861:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1786034615.711405:0:5861:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1786034615.711424:0:5861:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff964574cc3b80, transno 4294967321 00000004:00080000:3.0:1786034615.711437:0:5861:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff964574cc0380, transno 4294967322 00000100:00100000:3.0:1786034615.711443:0:5861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574cc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1872792636185856:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1786034615.711850:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1786034615.711917:0:5861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574769880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1872792636185984:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786034615.711951:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034615.712674:0:5861:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542f236c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034615.712712:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636185984 00000100:00100000:0.0:1786034615.712717:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636185984 00000100:00100000:0.0:1786034615.712747:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786034615.712754:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5861:x1872792636185984:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786034615.713240:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5861:x1872792636185984:12345-0@lo:1000:mdt00_000.0 Request processed in 485us (1287us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1786034615.713255:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786034615.713359:0:5861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574769880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1872792636185984:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1786034615.713390:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713399:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713407:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713414:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034615.713418:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713438:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713453:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9645821d2f00) 00010000:00010000:3.0:1786034615.713456:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786034615.713461:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713467:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00800/0x490975051af40b39 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713656:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40a7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713664:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40a7c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713671:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40a7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713676:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034615.713679:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40a7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713685:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40a7c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713694:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034615.713697:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786034615.713704:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75896f expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713727:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a83 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75896f expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713735:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75896f expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.713761:0:5861:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75896f expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034615.713774:0:5861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636186112:192.168.203.56@tcp:105: 00000100:00100000:3.0:1786034615.713920:0:5861:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542f236c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034615.724785:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034615.726327:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608934272 00000100:00100000:2.0:1786034615.726339:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608934272 00000100:00100000:2.0:1786034615.726468:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 61 00000100:00100000:2.0:1786034615.726478:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:11626:x1872792608934272:12345-192.168.203.56@tcp:49:lfs.0 00000100:00100000:3.0:1786034615.726721:0:5861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1872792636186112:192.168.203.56@tcp:105: 00010000:00010000:3.0:1786034615.726746:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40a7c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726755:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00c00/0x490975051af40a7c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726812:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726838:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726848:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726856:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726872:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b40 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726878:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726884:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034615.726889:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726896:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b40 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726907:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034615.726909:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034615.726913:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b40 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726919:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b40 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726930:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726936:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726956:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726961:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034615.726976:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726983:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.726995:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034615.726997:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786034615.727000:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.727005:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00a00/0x490975051af40b32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034615.727379:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:11626:x1872792608934272:12345-192.168.203.56@tcp:49:lfs.0 Request processed in 902us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034615.727388:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 61 00000040:00080000:3.0:1786034615.727620:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786034615.727624:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786034615.728145:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1786034615.728154:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786034615.728798:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+23:11627:x1872792608934016:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 30048us (30192us total) trans 4294967513 rc 0/0 00000100:00100000:3.0:1786034615.728808:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 230 00000020:00080000:3.0:1786034615.728812:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1786034615.735367:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034615.735469:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034615.735602:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608934528 00000100:00100000:1.0:1786034615.735611:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608934528 00000100:00100000:1.0:1786034615.735669:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 231 00000100:00100000:1.0:1786034615.735678:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+23:11626:x1872792608934528:12345-192.168.203.56@tcp:58:lfs.0 00000100:00100000:3.0:1786034615.736404:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608934784 00000100:00100000:3.0:1786034615.736409:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608934784 00000100:00100000:3.0:1786034615.736437:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 62 00000100:00100000:3.0:1786034615.736445:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ef7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+24:11627:x1872792608934784:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1786034615.737746:0:5864:0:(mdd_object.c:4291:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1786034615.737871:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:3.0:1786034615.737917:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.737942:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786034615.738695:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1786034615.738781:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:11626:x1872792608934528:12345-192.168.203.56@tcp:58:lfs.0 Request processed in 3102us (3834us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034615.738790:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 231 00010000:00010000:3.0:1786034615.744215:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.744228:0:5864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b47 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.744235:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b47 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.744241:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.744267:0:5864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786034615.744379:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ef7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+25:11627:x1872792608934784:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 Request processed in 7930us (8905us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1786034615.744388:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 62 00000020:00080000:3.0:1786034615.744404:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786034615.745913:0:7670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786034615.745924:0:7670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.745933:0:7670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1c00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:2.0:1786034615.745937:0:7670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.745960:0:7670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.745975:0:7670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96454a119500) 00010000:00010000:2.0:1786034615.745978:0:7670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786034615.745983:0:7670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b47 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.745989:0:7670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034615.746008:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034615.746010:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034615.746012:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034615.800750:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034615.800846:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608934912 00000100:00100000:0.0:1786034615.800855:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608934912 00000100:00100000:0.0:1786034615.800910:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 232 00000100:00100000:0.0:1786034615.800919:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+25:11629:x1872792608934912:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034615.800942:0:6743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034615.800977:0:6743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40b4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7589a7 expref: -99 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.801054:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.801476:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.801496:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.801513:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40b5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.801520:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.801526:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.801802:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40b63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.801840:0:6743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758968 expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.801850:0:6743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40b63 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.801882:0:6743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758968 expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.801895:0:6743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758968 expref: 26 pid: 5862 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034615.801909:0:6743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6743:1872792636186240:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034615.802693:0:6743:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454a943480 going to sleep for 11 seconds 00000100:00100000:3.0:1786034615.806929:0:6743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6743:1872792636186240:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034615.807283:0:6743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40b63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034615.808769:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034615.808905:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608935168 00000100:00100000:2.0:1786034615.808913:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608935168 00000100:00100000:2.0:1786034615.808975:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 63 00000100:00100000:2.0:1786034615.809262:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:5609:x1872792608935168:12345-192.168.203.56@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1786034615.809852:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+28:5609:x1872792608935168:12345-192.168.203.56@tcp:35:ldlm_bl.0 Request processed in 840us (1059us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1786034615.809862:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 63 00000100:00100000:0.0:1786034615.826143:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034615.826863:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608935296 00000100:00100000:3.0:1786034615.826873:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608935296 00010000:00010000:3.0:1786034615.826909:0:7671:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758968 expref: 28 pid: 5862 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034615.826974:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 84 00000100:00100000:3.0:1786034615.826984:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+28:2362:x1872792608935296:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034615.827000:0:7671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034615.827008:0:7671:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758968 expref: 28 pid: 5862 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.827022:0:7671:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758968 expref: 28 pid: 5862 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.827043:0:7671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40a6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758968 expref: 28 pid: 5862 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.827060:0:7671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034615.827066:0:7671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40b63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.827075:0:7671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.827081:0:7671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40b63 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034615.827103:0:7671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034615.827165:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:2362:x1872792608935296:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 181us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034615.827172:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 84 00010000:00010000:0.0:1786034615.827354:0:6743:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827363:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034615.827403:0:6743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1786034615.827407:0:6743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034615.827424:0:6743:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827435:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827457:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827463:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827470:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827476:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034615.827480:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827487:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827497:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:0.0:1786034615.827500:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034615.827504:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827510:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af40b55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827520:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827527:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40b5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827533:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827545:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034615.827548:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827555:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40b5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827563:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9645821d2a00) 00010000:00010000:0.0:1786034615.827566:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034615.827569:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40b5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827575:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8200/0x490975051af40b5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827609:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9e00/0x490975051af40b4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a7 expref: 27 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827623:0:6743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40b63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a7 expref: 26 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034615.827630:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:0.0:1786034615.827633:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786034615.827635:0:6743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8600, rc 0) 00000100:00100000:0.0:1786034615.829909:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:11629:x1872792608934912:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 28979us (29157us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034615.829924:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 232 00000100:00100000:1.0:1786034615.856048:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786034615.856070:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636186368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786034615.856173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034615.856407:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636186624:0@lo:400:kworker.0 00000100:00100000:2.0:1786034615.856438:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034615.856475:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786034615.856480:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636186496:0@lo:400:kworker.0 00000100:00100000:2.0:1786034615.856529:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034615.856555:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636187008:0@lo:400:kworker.0 00000100:00100000:2.0:1786034615.856584:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034615.856607:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636186496 00000100:00100000:2.0:1786034615.856613:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636186496 00000100:00100000:2.0:1786034615.856654:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1786034615.856661:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454ade8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636186496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034615.856702:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454ade8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3310:x1872792636186496:12345-0@lo:400:kworker.0 Request processed in 41us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034615.856709:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1786034615.856750:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636186752:0@lo:400:kworker.0 00000100:00100000:2.0:1786034615.856770:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034615.856784:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786034615.856789:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636186880:0@lo:400:kworker.0 00000100:00100000:2.0:1786034615.856808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034615.856861:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636186496:0@lo:400:kworker.0 00000100:00100000:2.0:1786034615.856895:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636186624 00000100:00100000:2.0:1786034615.856898:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636186624 00000100:00100000:2.0:1786034615.856921:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636187008 00000100:00100000:2.0:1786034615.856924:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636187008 00000100:00100000:2.0:1786034615.856943:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636186752 00000100:00100000:2.0:1786034615.856946:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636186752 00000100:00100000:2.0:1786034615.856960:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1786034615.856983:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636186624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034615.857020:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636186624:12345-0@lo:400:kworker.0 Request processed in 38us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034615.857025:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1786034615.857039:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1786034615.857045:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636187008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034615.857082:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636187008:12345-0@lo:400:kworker.0 Request processed in 37us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034615.857088:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1786034615.857101:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1786034615.857107:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636186752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034615.857136:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636186752:12345-0@lo:400:kworker.0 Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034615.857141:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:2.0:1786034615.857156:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034615.857175:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636187008:0@lo:400:kworker.0 00000100:00100000:2.0:1786034615.857184:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636186624:0@lo:400:kworker.0 00000100:00100000:2.0:1786034615.857206:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636186752:0@lo:400:kworker.0 00000100:00100000:2.0:1786034615.857225:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636186880 00000100:00100000:2.0:1786034615.857228:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636186880 00000100:00100000:2.0:1786034615.857256:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1786034615.857262:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636186880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034615.857306:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636186880:12345-0@lo:400:kworker.0 Request processed in 44us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034615.857313:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1786034615.857334:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636186880:0@lo:400:kworker.0 00000100:00100000:0.0:1786034615.857850:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636186368 00000100:00100000:0.0:1786034615.857861:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636186368 00000100:00100000:0.0:1786034615.857886:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1786034615.857893:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636186368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786034615.857909:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1786034615.857955:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872792636186368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034615.857970:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1786034615.858591:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636186368:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786034615.988175:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786034616.753071:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786034616.753081:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786034616.753116:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1786034616.753123:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786034616.753239:0:11732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457476ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11732:1872792636187136:192.168.203.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786034616.753343:0:11732:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454f664180 going to sleep for 11 seconds 00000100:00100000:0.0:1786034616.755375:0:11732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457476ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11732:1872792636187136:192.168.203.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786034616.756607:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034616.756661:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608935424 00000100:00100000:2.0:1786034616.756667:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608935424 00000100:00100000:2.0:1786034616.756720:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 233 00000100:00100000:2.0:1786034616.756739:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457476ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:11640:x1872792608935424:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786034616.756766:0:5862:0:(mdt_handler.c:8007:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786034616.756867:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457476ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:11640:x1872792608935424:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 Request processed in 129us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034616.756874:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 233 00000100:00100000:3.0:1786034616.760714:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034616.760789:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608935680 00000100:00100000:0.0:1786034616.760797:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608935680 00000100:00100000:3.0:1786034616.761018:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 234 00000100:00100000:3.0:1786034616.761029:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+26:11640:x1872792608935680:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786034616.761044:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034616.761062:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b6a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7589ae expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034616.761153:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034616.761167:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034616.761179:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034616.761189:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1786034616.761355:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b6a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589ae expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034616.761374:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589ae expref: 28 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034616.761400:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034616.761402:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034616.761405:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f1c00, rc 0) 00000100:00100000:3.0:1786034616.761498:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+28:11640:x1872792608935680:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 470us (790us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1786034616.761505:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 234 00000100:00100000:0.0:1786034616.776207:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034616.776317:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608935808 00000100:00100000:3.0:1786034616.776326:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608935808 00000100:00100000:3.0:1786034616.776374:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 18 00000100:00100000:3.0:1786034616.776381:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+28:2364:x1872792608935808:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034616.776396:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034616.776418:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589ae expref: 28 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034616.776435:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034616.776439:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034616.776521:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:2364:x1872792608935808:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 141us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034616.776528:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 18 00000100:00100000:2.0:1786034616.788409:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034616.788508:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608936064 00000100:00100000:1.0:1786034616.788517:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608936064 00000100:00100000:1.0:1786034616.788567:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 235 00000100:00100000:1.0:1786034616.788575:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+27:11640:x1872792608936064:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786034616.788646:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40b7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034616.788661:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40b7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034616.788671:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40b7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034616.788859:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40b7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034616.788867:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40b7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034616.788875:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40b7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034616.788881:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034616.788885:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40b7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034616.788892:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40b7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034616.788904:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:1.0:1786034616.788907:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786034616.788911:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40b7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034616.788935:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01c00/0x490975051af40b7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034616.790317:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+28:11640:x1872792608936064:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 1738us (1911us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1786034616.790327:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 235 00000040:00080000:2.0:1786034616.790552:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786034616.790557:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786034616.791188:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1786034616.791197:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786034616.813188:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034616.814583:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608936320 00000100:00100000:3.0:1786034616.814592:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608936320 00000100:00100000:3.0:1786034616.814663:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 64 00000100:00100000:3.0:1786034616.814671:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+28:11640:x1872792608936320:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786034616.814898:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:11640:x1872792608936320:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 Request processed in 227us (1717us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1786034616.814924:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 64 00010000:00010000:3.0:1786034617.009701:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786034617.181503:0:12554:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786034617.181511:0:12554:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786034617.181558:0:12554:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1786034617.181565:0:12554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786034617.509407:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034617.509522:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608936576 00000100:00100000:3.0:1786034617.509531:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608936576 00000100:00100000:3.0:1786034617.509707:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 236 00000100:00100000:3.0:1786034617.509718:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+29:11653:x1872792608936576:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034617.509740:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034617.509760:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7589b5 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034617.509884:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034617.509898:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034617.509910:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034617.509921:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00080000:2.0:1786034617.510118:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786034617.510173:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f1c00/0x490975051af40b86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589b5 expref: 32 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034617.510191:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589b5 expref: 31 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034617.510215:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034617.510218:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1786034617.510222:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0200, rc 0) 00000100:00100000:3.0:1786034617.510285:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:11653:x1872792608936576:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 569us (886us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1786034617.510292:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 236 00000100:00100000:3.0:1786034617.514003:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034617.514150:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608936704 00000100:00100000:2.0:1786034617.514158:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608936704 00000100:00100000:2.0:1786034617.514206:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 237 00000100:00100000:2.0:1786034617.514215:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:11653:x1872792608936704:12345-192.168.203.56@tcp:54:lfs.0 00010000:00010000:2.0:1786034617.514280:0:6743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40b9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034617.514294:0:6743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034617.514314:0:6743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034617.514338:0:6743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034617.514345:0:6743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40b9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034617.514368:0:6743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40b9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034617.514374:0:6743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034617.514379:0:6743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40b9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034617.514386:0:6743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40b9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034617.514397:0:6743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:2.0:1786034617.514400:0:6743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786034617.514404:0:6743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40b9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034617.514410:0:6743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6600/0x490975051af40b9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6743 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034617.518890:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:11653:x1872792608936704:12345-192.168.203.56@tcp:54:lfs.0 Request processed in 4667us (4885us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034617.518903:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 237 00000100:00100000:0.0:1786034617.636802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034617.639411:0:12516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608936832 00000100:00100000:2.0:1786034617.639425:0:12516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608936832 00000100:00100000:2.0:1786034617.639897:0:12516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 71 00000100:00100000:2.0:1786034617.639912:0:12516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2363:x1872792608936832:12345-192.168.203.56@tcp:101:cat.0 00010000:00010000:2.0:1786034617.639929:0:12516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034617.639960:0:12516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d625775/0x490975051af40ba2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7589bc expref: -99 pid: 12516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786034617.640013:0:12516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a74b9b5, atime: 0x6a74b9b5, ctime: 0x6a74b9b5, blocks: 0xb 00010000:00010000:2.0:1786034617.640042:0:12516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1786034617.640047:0:12516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034617.640057:0:12516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d625775/0x490975051af40ba2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589bc expref: 8 pid: 12516 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034617.640074:0:12516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001d625775/0x490975051af40ba2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589bc expref: 8 pid: 12516 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034617.640086:0:12516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6600, rc 0) 00000100:00100000:2.0:1786034617.640150:0:12516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2363:x1872792608936832:12345-192.168.203.56@tcp:101:cat.0 Request processed in 244us (3607us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034617.640157:0:12516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 71 00000100:00080000:0.0:1786034617.641411:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786034617.646209:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034617.646294:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608936960 00000100:00100000:1.0:1786034617.646312:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608936960 00002000:00100000:1.0:1786034617.646361:0:6726:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff964574df0700 x1872792608936960/t0(0) o3->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:588/0 lens 488/0 e 0 to 0 dl 1786034628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786034617.646371:0:6726:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574df0700 with x1872792608936960 ext(0->4095) 00002000:00010000:1.0:1786034617.646376:0:6726:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff964574df0700 00000100:00100000:1.0:1786034617.646405:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 7 00000100:00100000:1.0:1786034617.646415:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2363:x1872792608936960:12345-192.168.203.56@tcp:3:cat.0 00000100:00100000:1.0:1786034617.646949:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2363:x1872792608936960:12345-192.168.203.56@tcp:3:cat.0 Request processed in 535us (749us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786034617.646957:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 7 00002000:00100000:1.0:1786034617.646971:0:6726:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff964574df0700 x1872792608936960/t0(0) o3->696d4f9b-62ce-40a0-a754-08fa96a026cd@192.168.203.56@tcp:588/0 lens 488/4536 e 0 to 0 dl 1786034628 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786034617.646979:0:6726:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964574df0700 with x1872792608936960 ext(0->4095) 00002000:00010000:1.0:1786034617.646982:0:6726:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff964574df0700 00010000:00010000:2.0:1786034618.032109:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034618.210494:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034618.210536:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034618.210577:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034618.210603:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034618.210644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034618.210674:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608937600 00000100:00100000:3.0:1786034618.210683:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608937600 00000100:00100000:3.0:1786034618.210746:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608937216 00000100:00100000:3.0:1786034618.210749:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608937216 00000100:00100000:3.0:1786034618.210768:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 209 00000100:00100000:3.0:1786034618.210777:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457471f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608937600:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034618.210877:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457471f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2363:x1872792608937600:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034618.210884:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 209 00000100:00100000:3.0:1786034618.210899:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 210 00000100:00100000:3.0:1786034618.210906:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:2363:x1872792608937216:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034618.210930:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+31:2363:x1872792608937216:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 25us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034618.210946:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 210 00000100:00080000:3.0:1786034618.210980:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034618.211238:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608937088 00000100:00100000:2.0:1786034618.211243:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608937088 00000100:00100000:2.0:1786034618.211283:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 320 00000100:00100000:2.0:1786034618.211290:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608937088:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034618.211315:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608937088:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 26us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034618.211321:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 320 00000100:00100000:2.0:1786034618.211356:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608937344 00000100:00100000:2.0:1786034618.211359:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608937344 00000100:00100000:2.0:1786034618.211382:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608937472 00000100:00100000:2.0:1786034618.211385:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608937472 00000100:00100000:2.0:1786034618.211411:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 97 00000100:00100000:2.0:1786034618.211417:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457d65f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2363:x1872792608937344:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034618.211441:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457d65f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2363:x1872792608937344:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 25us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034618.211447:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 97 00000100:00100000:2.0:1786034618.211456:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 98 00000100:00100000:2.0:1786034618.211462:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2363:x1872792608937472:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034618.211478:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+8:2363:x1872792608937472:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 17us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034618.211484:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 98 00000100:00080000:2.0:1786034618.211511:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786034618.928087:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786034618.928110:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636187264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034618.928181:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034618.928294:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636187264 00000100:00100000:0.0:1786034618.928312:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636187264 00000100:00100000:0.0:1786034618.928393:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1786034618.928402:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636187264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034618.928432:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034618.928484:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636187264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034618.928490:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1786034618.928676:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786034618.928717:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636187264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786034619.069385:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034620.089725:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1786034620.543586:0:5883:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1786034620.543606:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:1.0:1786034620.543632:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1786034620.543650:0:5883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff964542f23300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1786034620.543655:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96457dfd4500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff964542f230c0 00000020:00080000:1.0:1786034620.543658:0:5883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96457dfd4b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff964574797c00 00000020:00080000:1.0:1786034620.543670:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1786034620.543853:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1786034620.581727:0:6746:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000040:00080000:2.0:1786034620.912057:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786034620.912079:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786034620.912119:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1786034620.912127:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786034620.976082:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636187776:0@lo:400:kworker.0 00000100:00100000:2.0:1786034620.976146:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034620.976203:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786034620.976210:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636187648:0@lo:400:kworker.0 00000100:00100000:2.0:1786034620.976245:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034620.976279:0:12516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636187776 00000100:00100000:2.0:1786034620.976286:0:12516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636187776 00000100:00100000:2.0:1786034620.976333:0:12516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1786034620.976343:0:12516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636187776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034620.976387:0:12516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636187776:12345-0@lo:400:kworker.0 Request processed in 47us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034620.976404:0:12516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1786034620.976422:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636187648 00000100:00100000:2.0:1786034620.976426:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636187648 00000100:00100000:2.0:1786034620.976450:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1786034620.976456:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636187648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034620.976494:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636187648:12345-0@lo:400:kworker.0 Request processed in 38us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034620.976500:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1786034620.976538:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636187648:0@lo:400:kworker.0 00000100:00100000:2.0:1786034620.976549:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1786034620.976553:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff964574cdc700, transno 4294967310 00000100:00100000:2.0:1786034620.976562:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636187776:0@lo:400:kworker.0 00000100:00100000:1.0:1786034620.976583:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636187520:0@lo:400:kworker.0 00000100:00100000:1.0:1786034620.976612:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034620.976631:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636188032:0@lo:400:kworker.0 00000100:00100000:1.0:1786034620.976649:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034620.976666:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786034620.976670:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636187392:0@lo:400:kworker.0 00000100:00100000:1.0:1786034620.976695:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034620.976714:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636187904:0@lo:400:kworker.0 00000100:00100000:1.0:1786034620.976733:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786034620.976756:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786034620.976760:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786034620.976784:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636187520 00000100:00100000:1.0:1786034620.976788:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636187520 00000100:00100000:1.0:1786034620.976807:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636187904 00000100:00100000:1.0:1786034620.976810:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636187904 00000100:00100000:1.0:1786034620.976857:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1786034620.976862:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636187520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034620.976874:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1786034620.976881:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636187904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034620.976893:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636187520:12345-0@lo:400:kworker.0 Request processed in 31us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034620.976899:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1786034620.976907:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636187904:12345-0@lo:400:kworker.0 Request processed in 27us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034620.976912:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1786034620.976917:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636188032 00000100:00100000:1.0:1786034620.976920:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636188032 00000100:00100000:1.0:1786034620.976948:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1786034620.976954:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1872792636188032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034620.976966:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636187392 00000100:00100000:2.0:1786034620.976970:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636187392 00000100:00100000:1.0:1786034620.976981:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1872792636188032:12345-0@lo:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034620.976987:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1786034620.976991:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1786034620.976996:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636187392:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1786034620.976999:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786034620.977001:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034620.977017:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636187904:0@lo:400:kworker.0 00000100:00100000:2.0:1786034620.977023:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636187392:12345-0@lo:400:kworker.0 Request processed in 28us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034620.977025:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636187520:0@lo:400:kworker.0 00000100:00100000:2.0:1786034620.977029:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1786034620.977034:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636188032:0@lo:400:kworker.0 00000100:00100000:1.0:1786034620.977052:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636187392:0@lo:400:kworker.0 00000100:00100000:0.0:1786034620.977300:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636188160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034620.977329:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034620.979133:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636188160 00000100:00100000:2.0:1786034620.979149:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636188160 00000100:00100000:2.0:1786034620.979195:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1786034620.979204:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636188160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034620.979231:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034620.979296:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636188160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034620.979465:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1786034620.983244:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636188160:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1786034621.089159:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1786034621.089174:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:2.0:1786034621.115005:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034622.132566:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034623.153650:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034623.331102:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034623.331137:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034623.331166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034623.331187:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034623.331213:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034623.331247:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608938240 00000100:00100000:1.0:1786034623.331268:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608938240 00000100:00100000:1.0:1786034623.331321:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608937856 00000100:00100000:1.0:1786034623.331324:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608937856 00000100:00100000:1.0:1786034623.331345:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 214 00000100:00100000:1.0:1786034623.331355:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608938240:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034623.331419:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2364:x1872792608938240:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 66us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034623.331426:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 214 00000100:00100000:1.0:1786034623.331444:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 215 00000100:00100000:1.0:1786034623.331450:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:2364:x1872792608937856:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034623.331474:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:2364:x1872792608937856:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 25us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034623.331480:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 215 00000100:00100000:1.0:1786034623.331500:0:12516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608937984 00000100:00100000:1.0:1786034623.331503:0:12516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608937984 00000100:00100000:1.0:1786034623.331526:0:12516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608938112 00000100:00100000:1.0:1786034623.331529:0:12516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608938112 00000100:00100000:1.0:1786034623.331546:0:12516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 101 00000100:00100000:1.0:1786034623.331551:0:12516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2364:x1872792608937984:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034623.331587:0:12516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2364:x1872792608937984:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 35us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034623.331593:0:12516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 101 00000100:00100000:1.0:1786034623.331603:0:12516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 102 00000100:00100000:1.0:1786034623.331609:0:12516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2364:x1872792608938112:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034623.331627:0:12516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2364:x1872792608938112:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 18us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034623.331639:0:12516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 102 00000100:00080000:1.0:1786034623.331652:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786034623.331656:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034623.331658:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034623.332181:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608937728 00000100:00100000:2.0:1786034623.332186:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608937728 00000100:00100000:2.0:1786034623.332227:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 322 00000100:00100000:2.0:1786034623.332234:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608937728:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034623.332259:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608937728:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 26us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034623.332265:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 322 00000100:00100000:1.0:1786034624.048640:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636188288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034624.048730:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034624.048802:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636188288 00000100:00100000:1.0:1786034624.048808:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636188288 00000100:00100000:1.0:1786034624.048877:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1786034624.048887:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636188288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786034624.048929:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034624.048972:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636188288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034624.048979:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1786034624.048998:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786034624.049028:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636188288:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786034624.180527:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034624.633726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034624.634061:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608938368 00000100:00100000:1.0:1786034624.634070:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608938368 00000100:00100000:1.0:1786034624.634141:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 238 00000100:00100000:1.0:1786034624.634151:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:11306:x1872792608938368:12345-192.168.203.56@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1786034624.636115:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:11306:x1872792608938368:12345-192.168.203.56@tcp:60:lhsmtool_posix.0 Request processed in 1959us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034624.636132:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 238 00000100:00100000:3.0:1786034624.657780:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034624.658316:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608938624 00000100:00100000:0.0:1786034624.658326:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608938624 00000100:00100000:0.0:1786034624.658373:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 65 00000100:00100000:0.0:1786034624.658382:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:11306:x1872792608938624:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786034624.668030:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:11306:x1872792608938624:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 Request processed in 9640us (10248us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1786034624.668044:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 65 00010000:00010000:2.0:1786034625.200090:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034625.543971:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034625.544143:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608938752 00000100:00100000:1.0:1786034625.544153:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608938752 00000100:00100000:1.0:1786034625.544236:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 239 00000100:00100000:1.0:1786034625.544261:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:12105:x1872792608938752:12345-192.168.203.56@tcp:101:lsof.0 00010000:00010000:1.0:1786034625.544280:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034625.544340:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40ba9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7589c3 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034625.544399:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40bb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034625.544413:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034625.544425:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034625.544599:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786034625.544604:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1786034625.544687:0:5862:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034625.544711:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01200/0x490975051af40ba9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589c3 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034625.544726:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589c3 expref: 6 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034625.544735:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4800) 00010000:00010000:1.0:1786034625.544737:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786034625.544741:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01000, rc 0) 00000100:00100000:1.0:1786034625.544798:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:12105:x1872792608938752:12345-192.168.203.56@tcp:101:lsof.0 Request processed in 541us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034625.544813:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 239 00000100:00080000:2.0:1786034625.544903:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1786034625.646995:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1786034625.647019:0:5883:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1786034625.647321:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1786034625.647335:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1786034626.096079:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636188544:0@lo:400:kworker.0 00000100:00100000:2.0:1786034626.096106:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636188800:0@lo:400:kworker.0 00000100:00100000:2.0:1786034626.096156:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034626.096158:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034626.096236:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636189056:0@lo:400:kworker.0 00000100:00100000:0.0:1786034626.096257:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636188672:0@lo:400:kworker.0 00000100:00100000:1.0:1786034626.096266:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034626.096295:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034626.096298:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786034626.096319:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636189184:0@lo:400:kworker.0 00000100:00100000:1.0:1786034626.096325:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636188416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034626.096347:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034626.096370:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034626.096384:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636188800 00000100:00100000:0.0:1786034626.096391:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636188800 00000100:00100000:1.0:1786034626.096400:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636188928:0@lo:400:kworker.0 00000100:00100000:1.0:1786034626.096428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034626.096458:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636189056 00000100:00100000:0.0:1786034626.096462:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636189056 00000100:00100000:1.0:1786034626.096469:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636188672 00000100:00100000:1.0:1786034626.096475:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636188672 00000100:00100000:0.0:1786034626.096486:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1786034626.096506:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636188800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034626.096511:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1786034626.096523:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636189056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034626.096562:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636188800:12345-0@lo:400:kworker.0 Request processed in 67us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034626.096570:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1786034626.096582:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636189056:12345-0@lo:400:kworker.0 Request processed in 60us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034626.096590:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1786034626.096613:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636188672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034626.096645:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636188672:12345-0@lo:400:kworker.0 Request processed in 33us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034626.096854:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636188544 00000100:00100000:3.0:1786034626.096858:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636188544 00000100:00100000:3.0:1786034626.096884:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1786034626.096890:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636188544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034626.096923:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636188544:12345-0@lo:400:kworker.0 Request processed in 33us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034626.096929:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1786034626.097392:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636188800:0@lo:400:kworker.0 00000100:00080000:3.0:1786034626.098349:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034626.098367:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636188416 00000100:00100000:3.0:1786034626.098372:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636188416 00000100:00100000:3.0:1786034626.098411:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1786034626.098431:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636188416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786034626.098457:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034626.098507:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636188416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034626.098513:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1786034626.098533:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636189184 00000100:00100000:3.0:1786034626.098537:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636189184 00000100:00100000:3.0:1786034626.098568:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636188928 00000100:00100000:3.0:1786034626.098571:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636188928 00000100:00100000:3.0:1786034626.098595:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1786034626.098601:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636189184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034626.098639:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636189184:12345-0@lo:400:kworker.0 Request processed in 38us (2292us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034626.098645:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1786034626.098973:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1786034626.098981:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636188928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034626.099011:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636188928:12345-0@lo:400:kworker.0 Request processed in 32us (2582us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034626.099017:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1786034626.099035:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786034626.099038:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786034626.099071:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1786034626.099077:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1786034626.099097:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636188416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034626.099107:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636188928:0@lo:400:kworker.0 00000100:00100000:3.0:1786034626.099116:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636189056:0@lo:400:kworker.0 00000100:00100000:3.0:1786034626.099124:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636188544:0@lo:400:kworker.0 00000100:00100000:1.0:1786034626.101276:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1786034626.102125:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1786034626.102185:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636188672:0@lo:400:kworker.0 00000100:00100000:0.0:1786034626.102206:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636189184:0@lo:400:kworker.0 00010000:00010000:0.0:1786034626.225170:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034627.248161:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034628.273760:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034628.446805:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034628.446885:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034628.446920:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034628.446940:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608939136 00000100:00100000:3.0:1786034628.446947:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034628.446949:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608939136 00000100:00100000:3.0:1786034628.446970:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034628.446999:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608939392 00000100:00100000:0.0:1786034628.447002:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608939264 00000100:00100000:3.0:1786034628.447003:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608939392 00000100:00100000:0.0:1786034628.447005:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608939264 00000100:00100000:3.0:1786034628.447027:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608939008 00000100:00100000:3.0:1786034628.447029:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608939008 00000100:00100000:0.0:1786034628.447040:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 105 00000100:00100000:0.0:1786034628.447049:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608939136:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034628.447062:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 219 00000100:00100000:3.0:1786034628.447068:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2362:x1872792608939392:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034628.447134:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 220 00000100:00100000:2.0:1786034628.447145:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:2362:x1872792608939008:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034628.447229:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2362:x1872792608939392:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 160us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034628.447237:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 219 00000100:00100000:3.0:1786034628.447262:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 106 00000100:00100000:3.0:1786034628.447269:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2362:x1872792608939264:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034628.447326:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608938880 00000100:00100000:1.0:1786034628.447330:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608938880 00000100:00100000:1.0:1786034628.447358:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 324 00000100:00100000:1.0:1786034628.447364:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608938880:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034628.449317:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2362:x1872792608939136:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 2263us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034628.449325:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 105 00000100:00080000:0.0:1786034628.449351:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786034628.449355:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786034628.449357:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786034628.459498:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:2362:x1872792608939008:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 12347us (12540us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034628.459512:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 220 00000100:00100000:3.0:1786034628.465035:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2362:x1872792608939264:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 17754us (18051us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034628.465051:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 106 00000100:00100000:0.0:1786034628.466592:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2362:x1872792608938880:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 19222us (19790us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034628.466604:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 324 00000100:00100000:0.0:1786034629.168126:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034629.168149:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636189312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786034629.168221:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034629.168351:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636189312 00000100:00100000:1.0:1786034629.168358:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636189312 00000100:00080000:3.0:1786034629.175779:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786034629.182586:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1786034629.182608:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636189312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786034629.182644:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034629.182722:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636189312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (14501us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034629.182729:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1786034629.182864:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636189312:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786034629.296957:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786034630.128069:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786034630.128078:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786034630.128525:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1786034630.128533:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786034630.324233:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034631.216714:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636189568:0@lo:400:kworker.0 00000100:00100000:2.0:1786034631.216720:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636189440:0@lo:400:kworker.0 00000100:00100000:1.0:1786034631.222610:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636189824:0@lo:400:kworker.0 00000100:00100000:0.0:1786034631.222792:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034631.222844:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636189568 00000100:00100000:3.0:1786034631.222853:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636189568 00000100:00100000:3.0:1786034631.222915:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1786034631.222927:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636189568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034631.223004:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636190080:0@lo:400:kworker.0 00000100:00100000:3.0:1786034631.223013:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636189568:12345-0@lo:400:kworker.0 Request processed in 89us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034631.223020:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1786034631.223036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034631.223137:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034631.224304:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034631.224333:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786034631.224335:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636189568:0@lo:400:kworker.0 00000100:00100000:1.0:1786034631.224340:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636189696:0@lo:400:kworker.0 00000100:00100000:1.0:1786034631.224365:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034631.224392:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636189696 00000100:00100000:1.0:1786034631.224394:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636190208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034631.224396:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636189696 00000100:00100000:1.0:1786034631.224417:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034631.224440:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1786034631.224445:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636190080 00000100:00100000:1.0:1786034631.224448:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636190080 00000100:00100000:0.0:1786034631.224449:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636189696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034631.224490:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636189696:12345-0@lo:400:kworker.0 Request processed in 42us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034631.224497:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1786034631.224540:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636189824 00000100:00100000:1.0:1786034631.224544:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636189824 00000100:00100000:1.0:1786034631.224567:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1786034631.224573:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636190080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034631.224607:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636190080:12345-0@lo:400:kworker.0 Request processed in 34us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034631.224613:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1786034631.224625:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786034631.224630:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636189824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034631.226753:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636189824:12345-0@lo:400:kworker.0 Request processed in 2117us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034631.226777:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786034631.226839:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636189696:0@lo:400:kworker.0 00000100:00100000:1.0:1786034631.226849:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636189824:0@lo:400:kworker.0 00000100:00080000:3.0:1786034631.232210:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786034631.232223:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786034631.232228:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034631.232251:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636190208 00000100:00100000:3.0:1786034631.232264:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636190208 00000100:00100000:3.0:1786034631.232358:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1786034631.232367:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636190208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786034631.232521:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034631.232621:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636190208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 255us (8202us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034631.232629:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1786034631.232705:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636189440 00000100:00100000:3.0:1786034631.232710:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636189440 00000100:00100000:3.0:1786034631.232736:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1786034631.232742:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636189440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034631.232776:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636189440:12345-0@lo:400:kworker.0 Request processed in 34us (9646us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034631.232783:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1786034631.232871:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636190208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786034631.234628:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636190080:0@lo:400:kworker.0 00000100:00100000:2.0:1786034631.236122:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636189440:0@lo:400:kworker.0 00000100:00100000:2.0:1786034631.236137:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636189952:0@lo:400:kworker.0 00000100:00100000:2.0:1786034631.236202:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034631.237160:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636189952 00000100:00100000:1.0:1786034631.237181:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636189952 00000100:00100000:1.0:1786034631.237268:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1786034631.237277:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636189952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034631.237346:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636189952:12345-0@lo:400:kworker.0 Request processed in 71us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034631.237353:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:3.0:1786034631.237744:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034631.239326:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636189952:0@lo:400:kworker.0 00010000:00010000:2.0:1786034631.347147:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786034631.937477:0:12760:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:43:49 (1786034629) 00010000:00010000:0.0:1786034632.368700:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034633.394449:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034633.577570:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034633.577615:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034633.577725:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608939520 00000100:00100000:3.0:1786034633.577734:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608939520 00000100:00100000:3.0:1786034633.577782:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 326 00000100:00100000:3.0:1786034633.577790:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2365:x1872792608939520:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034633.577880:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2365:x1872792608939520:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 90us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034633.577888:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 326 00000100:00100000:0.0:1786034633.578731:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034633.579143:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034633.579182:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034633.579208:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608939776 00000100:00100000:0.0:1786034633.579214:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608939776 00000100:00100000:0.0:1786034633.579315:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608939904 00000100:00100000:0.0:1786034633.579319:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608939904 00000100:00100000:0.0:1786034633.579346:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 109 00000100:00100000:0.0:1786034633.579353:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2365:x1872792608939776:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034633.579506:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2365:x1872792608939776:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 153us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034633.579520:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 109 00000100:00100000:0.0:1786034633.579536:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 110 00000100:00100000:0.0:1786034633.579542:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2365:x1872792608939904:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034633.579570:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2365:x1872792608939904:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 27us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034633.579575:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 110 00000100:00100000:0.0:1786034633.580036:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608940032 00000100:00100000:0.0:1786034633.580040:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608940032 00000100:00100000:0.0:1786034633.580069:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608939648 00000100:00100000:0.0:1786034633.580072:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608939648 00000100:00100000:0.0:1786034633.580092:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 224 00000100:00100000:0.0:1786034633.580099:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2365:x1872792608940032:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034633.580133:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2365:x1872792608940032:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 34us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034633.580139:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 224 00000100:00100000:0.0:1786034633.580163:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 225 00000100:00100000:0.0:1786034633.580169:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:2365:x1872792608939648:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034633.580192:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:2365:x1872792608939648:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 23us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034633.580197:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 225 00000100:00080000:0.0:1786034633.580217:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786034633.580221:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786034633.580223:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786034634.289140:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034634.289171:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636190336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786034634.289260:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034634.289676:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636190336 00000100:00100000:1.0:1786034634.289684:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636190336 00000100:00100000:1.0:1786034634.289751:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1786034634.289760:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636190336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786034634.289793:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034634.289869:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636190336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034634.289876:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1786034634.289919:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636190336:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786034634.290170:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786034634.438470:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034635.440067:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034636.336696:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636190848:0@lo:400:kworker.0 00000100:00100000:2.0:1786034636.336761:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034636.336820:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786034636.336849:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636190720:0@lo:400:kworker.0 00000100:00100000:2.0:1786034636.336876:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034636.336894:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636191232:0@lo:400:kworker.0 00000100:00100000:2.0:1786034636.336914:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034636.336944:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636190848 00000100:00100000:2.0:1786034636.336950:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636190848 00000100:00100000:2.0:1786034636.336996:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636190720 00000100:00100000:2.0:1786034636.336999:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636190720 00000100:00100000:2.0:1786034636.337036:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1786034636.337045:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636190848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034636.337093:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636190848:12345-0@lo:400:kworker.0 Request processed in 48us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034636.337100:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1786034636.337115:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1786034636.337121:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636190720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034636.337160:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636190720:12345-0@lo:400:kworker.0 Request processed in 39us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034636.337166:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:2.0:1786034636.337183:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034636.337224:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636190720:0@lo:400:kworker.0 00000100:00100000:2.0:1786034636.337235:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636190848:0@lo:400:kworker.0 00000100:00100000:3.0:1786034636.337357:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636190464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034636.337397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034636.337422:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636190976:0@lo:400:kworker.0 00000100:00100000:3.0:1786034636.337452:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034636.337476:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786034636.337481:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636190592:0@lo:400:kworker.0 00000100:00100000:3.0:1786034636.337505:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034636.337523:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636191104:0@lo:400:kworker.0 00000100:00100000:3.0:1786034636.337540:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034636.337559:0:12516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636191232 00000100:00100000:3.0:1786034636.337562:0:12516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636191232 00000100:00100000:3.0:1786034636.337588:0:12516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636190976 00000100:00100000:3.0:1786034636.337590:0:12516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636190976 00000100:00100000:3.0:1786034636.337607:0:12516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1786034636.337613:0:12516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636191232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034636.337641:0:12516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636191232:12345-0@lo:400:kworker.0 Request processed in 29us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034636.337646:0:12516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1786034636.337658:0:12516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1786034636.337664:0:12516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636190976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034636.337691:0:12516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636190976:12345-0@lo:400:kworker.0 Request processed in 28us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034636.337697:0:12516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1786034636.337714:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636190592 00000100:00100000:3.0:1786034636.337717:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636190592 00000100:00100000:3.0:1786034636.337739:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1786034636.337745:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636190592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034636.337773:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3307:x1872792636190592:12345-0@lo:400:kworker.0 Request processed in 28us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034636.337800:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00080000:3.0:1786034636.337843:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786034636.337846:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786034636.337860:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636190592:0@lo:400:kworker.0 00000100:00100000:3.0:1786034636.337871:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636190976:0@lo:400:kworker.0 00000100:00100000:2.0:1786034636.338206:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636190464 00000100:00100000:2.0:1786034636.338211:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636190464 00000100:00100000:2.0:1786034636.338247:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1786034636.338254:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636190464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034636.338281:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034636.338315:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636190464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034636.338321:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1786034636.338335:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636191104 00000100:00100000:2.0:1786034636.338338:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636191104 00000100:00100000:2.0:1786034636.338360:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1786034636.338365:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636191104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034636.338405:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636191104:12345-0@lo:400:kworker.0 Request processed in 40us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034636.338417:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1786034636.338443:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636191232:0@lo:400:kworker.0 00000100:00080000:3.0:1786034636.339546:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034636.339582:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636191104:0@lo:400:kworker.0 00000100:00100000:3.0:1786034636.339603:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636190464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786034636.464084:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034637.489466:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034638.512110:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034638.697061:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034638.697099:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034638.697146:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034638.697172:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034638.697196:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034638.697264:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608940160 00000100:00100000:3.0:1786034638.697282:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608940160 00000100:00100000:3.0:1786034638.697333:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 328 00000100:00100000:3.0:1786034638.697342:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608940160:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034638.697423:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608940160:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 81us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034638.697431:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 328 00000100:00100000:3.0:1786034638.697545:0:12516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608940544 00000100:00100000:3.0:1786034638.697548:0:12516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608940544 00000100:00100000:3.0:1786034638.697691:0:12516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608940416 00000100:00100000:3.0:1786034638.697695:0:12516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608940416 00000100:00100000:3.0:1786034638.697731:0:12516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 113 00000100:00100000:3.0:1786034638.697737:0:12516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2363:x1872792608940544:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034638.697780:0:12516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2363:x1872792608940544:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 43us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034638.697786:0:12516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 113 00000100:00100000:3.0:1786034638.697812:0:12516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 72 00000100:00100000:2.0:1786034638.698398:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608940288 00000100:00100000:2.0:1786034638.698403:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608940288 00000100:00100000:2.0:1786034638.698433:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608940672 00000100:00100000:2.0:1786034638.698436:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608940672 00000100:00100000:2.0:1786034638.698459:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 229 00000100:00100000:2.0:1786034638.698466:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:2363:x1872792608940288:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034638.698498:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:2363:x1872792608940288:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 33us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034638.698504:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 229 00000100:00100000:2.0:1786034638.698516:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 230 00000100:00100000:2.0:1786034638.698522:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2363:x1872792608940672:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034638.698545:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2363:x1872792608940672:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 23us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034638.698550:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 230 00000100:00100000:3.0:1786034638.699066:0:12516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2361:x1872792608940416:12345-192.168.203.56@tcp:9:kworker.0 00000020:00000080:3.0:1786034638.699089:0:12516:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3ff00 00000100:00080000:3.0:1786034638.699098:0:12516:0:(import.c:65:import_set_state_nolock()) ffff964574736000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786034638.699154:0:12516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:1.0:1786034638.699696:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786034638.699701:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034638.699704:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786034638.699731:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034638.700516:0:12516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:696d4f9b-62ce-40a0-a754-08fa96a026cd+2:2361:x1872792608940416:12345-192.168.203.56@tcp:9:kworker.0 Request processed in 1453us (3316us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034638.700525:0:12516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 72 00000100:00100000:0.0:1786034638.884294:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034638.884454:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608940928 00000100:00100000:2.0:1786034638.884467:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608940928 00000100:00100000:2.0:1786034638.884597:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 66 00000100:00100000:2.0:1786034638.884608:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+18:12327:x1872792608940928:12345-192.168.203.56@tcp:35:umount.0 00000100:00100000:2.0:1786034638.885190:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:12327:x1872792608940928:12345-192.168.203.56@tcp:35:umount.0 Request processed in 583us (909us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1786034638.885198:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 66 00000100:00100000:3.0:1786034638.887314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034638.903215:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608941184 00000100:00100000:0.0:1786034638.903439:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608941184 00000100:00100000:1.0:1786034638.908570:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 67 00000100:00100000:1.0:1786034638.908596:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+19:12327:x1872792608941184:12345-192.168.203.56@tcp:35:umount.0 00000100:00100000:1.0:1786034638.908991:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:12327:x1872792608941184:12345-192.168.203.56@tcp:35:umount.0 Request processed in 396us (21683us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1786034638.908999:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 67 00000100:00100000:3.0:1786034638.910930:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034638.928126:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608941440 00000100:00100000:2.0:1786034638.928150:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608941440 00000100:00100000:2.0:1786034638.928214:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 68 00000100:00100000:2.0:1786034638.928224:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542ef5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+20:12327:x1872792608941440:12345-192.168.203.56@tcp:35:umount.0 00000100:00100000:2.0:1786034638.930246:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542ef5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:12327:x1872792608941440:12345-192.168.203.56@tcp:35:umount.0 Request processed in 2019us (19320us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1786034638.930257:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 68 00000100:00100000:0.0:1786034638.954033:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034638.958818:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608941696 00000100:00100000:2.0:1786034638.958845:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608941696 00000100:00100000:0.0:1786034638.961638:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 69 00000100:00100000:0.0:1786034638.961658:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+21:12327:x1872792608941696:12345-192.168.203.56@tcp:35:umount.0 00000100:00100000:0.0:1786034638.962369:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:696d4f9b-62ce-40a0-a754-08fa96a026cd+22:12327:x1872792608941696:12345-192.168.203.56@tcp:35:umount.0 Request processed in 718us (8550us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1786034638.962438:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 69 00000100:00100000:3.0:1786034638.966251:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034638.966380:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608941824 00000100:00100000:2.0:1786034638.966393:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608941824 00000100:00100000:2.0:1786034638.966479:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 19 00000100:00100000:2.0:1786034638.966491:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454acecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2363:x1872792608941824:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034638.966513:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034638.966539:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964582166a00/0x490975051af3fbc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75854e expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034638.966561:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034638.966626:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454acecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:2363:x1872792608941824:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 138us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034638.966635:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 19 00000100:00100000:0.0:1786034638.972472:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034638.975400:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034638.980297:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034638.980465:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608942336 00000100:00100000:1.0:1786034638.980477:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608942336 00000100:00100000:1.0:1786034638.980548:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 73 00000100:00100000:1.0:1786034638.980559:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+7:2361:x1872792608942336:12345-192.168.203.56@tcp:9:umount.0 00000020:00000080:1.0:1786034638.980598:0:6719:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af40168 00000020:00010000:1.0:1786034638.980609:0:6719:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96454adf5800: total 0 00000100:00080000:1.0:1786034638.980614:0:6719:0:(import.c:65:import_set_state_nolock()) ffff96454adf3000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786034638.980660:0:6719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1786034638.981270:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:696d4f9b-62ce-40a0-a754-08fa96a026cd+5:2361:x1872792608942336:12345-192.168.203.56@tcp:9:umount.0 Request processed in 711us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034638.981280:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 73 00000020:00010000:1.0:1786034638.981303:0:5849:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96454adf5800: total 0 00010000:00010000:1.0:1786034638.981886:0:5849:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96454adf5800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1786034638.981954:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b367a834/0x490975051af40504 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587ee expref: 4 pid: 6720 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034638.981992:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d625775/0x490975051af40ba2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589bc expref: 3 pid: 12516 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034638.982010:0:5849:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96454adf5800, canceled 2 locks, left on hash table 0. 00000100:00100000:2.0:1786034638.982252:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608941952 00000100:00100000:2.0:1786034638.982265:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608941952 00000100:00100000:2.0:1786034638.982336:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608942464 00000100:00100000:2.0:1786034638.982339:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608942464 00000100:00100000:2.0:1786034638.982371:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00100000:3.0:1786034638.982499:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 21 00000100:00100000:3.0:1786034638.982513:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c13892d0-993e-46f4-852e-b7a576d2b5bb+13:2364:x1872792608942464:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034638.982532:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034638.982547:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964574d00000/0x490975051af3fe3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758619 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034638.982561:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034638.982593:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:2364:x1872792608942464:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 85us (7207us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034638.982605:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:2363:x1872792608941952:12345-192.168.203.56@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1786034638.982610:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 21 00010000:00010000:2.0:1786034638.982647:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034638.982676:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f0400/0x490975051af3fb8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758516 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034638.982696:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786034638.982697:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034638.982702:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034638.982717:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034638.982908:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2363:x1872792608941952:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 525us (10585us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034638.982967:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00100000:0.0:1786034638.998891:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034638.999048:0:6743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608943488 00000100:00100000:2.0:1786034638.999056:0:6743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608943488 00000100:00100000:2.0:1786034638.999149:0:6743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 240 00000100:00100000:2.0:1786034638.999159:0:6743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+22:2361:x1872792608943488:12345-192.168.203.56@tcp:39:umount.0 00000020:00000080:2.0:1786034638.999189:0:6743:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fb9c 00000020:00010000:2.0:1786034638.999202:0:6743:0:(genops.c:1942:obd_stale_export_put()) Put export ffff964445079800: total 0 00000100:00080000:2.0:1786034638.999207:0:6743:0:(import.c:65:import_set_state_nolock()) ffff964551853000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786034638.999243:0:6743:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1786034638.999267:0:5850:0:(genops.c:1928:obd_stale_export_get()) Get export ffff964445079800: total 0 00010000:00010000:3.0:1786034638.999346:0:5850:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff964445079800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1786034638.999401:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:3.0:1786034638.999421:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786034638.999434:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7a00/0x490975051af401c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758715 expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034638.999466:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96455a530000) 00010000:00010000:3.0:1786034638.999469:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786034638.999476:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6800/0x490975051af3fe66 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758627 expref: 20 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034638.999527:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:3.0:1786034638.999530:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786034638.999536:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af40861 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7588e3 expref: 20 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034638.999555:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff964547ee4900) 00010000:00010000:3.0:1786034638.999558:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786034638.999562:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8000/0x490975051af3fed6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758643 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034638.999585:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034638.999589:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786034638.999594:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0800/0x490975051af40a83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75896f expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034638.999616:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff964547ee4b00) 00010000:00010000:3.0:1786034638.999619:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786034638.999624:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8a00/0x490975051af40582 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758811 expref: 18 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034638.999658:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:3.0:1786034638.999661:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786034638.999667:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0000/0x490975051af403e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587a1 expref: 15 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034638.999682:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9645521d1700) 00010000:00010000:3.0:1786034638.999685:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034638.999690:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01800/0x490975051af3fe82 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75862e expref: 14 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034638.999704:0:6743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:696d4f9b-62ce-40a0-a754-08fa96a026cd+14:2361:x1872792608943488:12345-192.168.203.56@tcp:39:umount.0 Request processed in 543us (818us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1786034638.999728:0:6743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 240 00010000:00010000:1.0:1786034639.006977:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4800) 00010000:00010000:1.0:1786034639.006989:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786034639.007003:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40566 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75880a expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034639.007037:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:1.0:1786034639.007040:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1786034639.007045:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af40b8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589b5 expref: 11 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034639.007061:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:1.0:1786034639.007064:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034639.007068:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7200/0x490975051af404c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587d9 expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034639.007080:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff964547ee4500) 00010000:00010000:1.0:1786034639.007082:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1786034639.007085:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d00e00/0x490975051af404ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7587e7 expref: 9 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034639.007101:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96454a119900) 00010000:00010000:1.0:1786034639.007103:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034639.007106:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8600/0x490975051af40b63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589a7 expref: 8 pid: 6743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034639.007132:0:5850:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff964445079800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1786034639.007171:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034639.007173:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034639.007194:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034639.408139:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636191360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034639.408212:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034639.408378:0:10126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636191360 00000100:00100000:3.0:1786034639.408385:0:10126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636191360 00000100:00100000:3.0:1786034639.408439:0:10126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1786034639.408447:0:10126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636191360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786034639.408478:0:10126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034639.408519:0:10126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636191360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034639.408526:0:10126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1786034639.408678:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786034639.409973:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636191360:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786034639.535923:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786034640.370219:0:11732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786034640.370227:0:11732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786034640.370805:0:11732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786034640.370815:0:11732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786034640.560252:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1786034641.016690:0:6746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 696d4f9b-62ce-40a0-a754-08fa96a026cd 00000020:00000080:2.0:1786034641.016699:0:6746:0:(genops.c:906:class_export_put()) final put ffff964574733800/696d4f9b-62ce-40a0-a754-08fa96a026cd 00000020:00000080:0.0:1786034641.016775:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff964574733800/696d4f9b-62ce-40a0-a754-08fa96a026cd for lustre-OST0000 00000020:00000080:0.0:1786034641.016844:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff964574736000 for lustre-OST0000 00000001:00080000:2.0:1786034641.018709:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:2.0:1786034641.018735:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 696d4f9b-62ce-40a0-a754-08fa96a026cd 00000001:00080000:2.0:1786034641.018753:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1786034641.018761:0:5883:0:(genops.c:906:class_export_put()) final put ffff964445079800/696d4f9b-62ce-40a0-a754-08fa96a026cd 00000020:00000080:1.0:1786034641.018854:0:10438:0:(genops.c:865:class_export_destroy()) destroying export ffff964445079800/696d4f9b-62ce-40a0-a754-08fa96a026cd for lustre-MDT0000 00000020:00000080:1.0:1786034641.018909:0:10438:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff964551853000 for lustre-MDT0000 00000100:00100000:3.0:1786034641.459294:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636191616:0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.459368:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034641.459419:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636192128:0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.459453:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034641.459481:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786034641.459486:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636191488:0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.459509:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034641.459526:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636192000:0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.459553:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034641.459578:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636191744:0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.459601:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034641.459617:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034641.459622:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636191872:0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.459639:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034641.459664:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636191616 00000100:00100000:3.0:1786034641.459670:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636191616 00000100:00100000:3.0:1786034641.459703:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636192000 00000100:00100000:3.0:1786034641.459705:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636192000 00000100:00100000:3.0:1786034641.459725:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636191744 00000100:00100000:3.0:1786034641.459727:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636191744 00000100:00100000:3.0:1786034641.459744:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1786034641.459752:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636191616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.459798:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636191616:12345-0@lo:400:kworker.0 Request processed in 47us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034641.459806:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1786034641.459841:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1786034641.459848:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636192000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.459875:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636192000:12345-0@lo:400:kworker.0 Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034641.459880:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1786034641.459899:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1786034641.459905:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636191744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.459936:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636191744:12345-0@lo:400:kworker.0 Request processed in 31us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034641.459942:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1786034641.459958:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636192128 00000100:00100000:3.0:1786034641.459961:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636192128 00000100:00100000:3.0:1786034641.459984:0:8676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636191872 00000100:00100000:3.0:1786034641.459986:0:8676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636191872 00000100:00100000:3.0:1786034641.460005:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1786034641.460014:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636192128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.460042:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636192128:12345-0@lo:400:kworker.0 Request processed in 31us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034641.460047:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1786034641.460057:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1786034641.460062:0:8676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636191872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.460085:0:8676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636191872:12345-0@lo:400:kworker.0 Request processed in 23us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034641.460090:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1786034641.460116:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636191488 00000100:00100000:3.0:1786034641.460119:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636191488 00000100:00100000:3.0:1786034641.460141:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1786034641.460146:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636191488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.460175:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636191488:12345-0@lo:400:kworker.0 Request processed in 29us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034641.460181:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00080000:3.0:1786034641.460208:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786034641.460217:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786034641.460219:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034641.460243:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636191488:0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.460255:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636192000:0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.460264:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636191616:0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.460272:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636192128:0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.460301:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636191872:0@lo:400:kworker.0 00000100:00100000:3.0:1786034641.460311:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636191744:0@lo:400:kworker.0 00000100:00100000:2.0:1786034641.461567:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786034641.461579:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636192256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034641.461614:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034641.461686:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636192256 00000100:00100000:0.0:1786034641.461691:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636192256 00000100:00100000:0.0:1786034641.461740:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1786034641.461748:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636192256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786034641.461782:0:6722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034641.461819:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636192256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034641.461858:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1786034641.462113:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636192256:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1786034641.492379:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 696d4f9b-62ce-40a0-a754-08fa96a026cd 00000020:00000080:1.0:1786034641.492388:0:7682:0:(genops.c:906:class_export_put()) final put ffff96454adf5800/696d4f9b-62ce-40a0-a754-08fa96a026cd 00000020:00000080:1.0:1786034641.492414:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96454adf5800/696d4f9b-62ce-40a0-a754-08fa96a026cd for lustre-OST0001 00000020:00000080:1.0:1786034641.492453:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96454adf3000 for lustre-OST0001 00010000:00010000:1.0:1786034641.583968:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034642.438953:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034642.438991:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034642.439022:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034642.439058:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034642.439134:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608943616 00000100:00100000:0.0:1786034642.439142:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608943616 00000100:00100000:0.0:1786034642.439196:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608943872 00000100:00100000:0.0:1786034642.439199:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608943872 00000100:00100000:0.0:1786034642.439210:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608943744 00000100:00100000:0.0:1786034642.439212:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608943744 00000100:00100000:0.0:1786034642.439225:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:0.0:1786034642.439233:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c13892d0-993e-46f4-852e-b7a576d2b5bb+12:2363:x1872792608943616:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034642.439247:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034642.439265:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964582166800/0x490975051af3fc6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758563 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034642.439282:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034642.439326:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c13892d0-993e-46f4-852e-b7a576d2b5bb+11:2363:x1872792608943616:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 94us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034642.439333:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:0.0:1786034642.439350:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 23 00000100:00100000:0.0:1786034642.439356:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c13892d0-993e-46f4-852e-b7a576d2b5bb+10:2363:x1872792608943872:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034642.439363:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034642.439372:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964542df8800/0x490975051af3fe35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758612 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034642.439380:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034642.439410:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c13892d0-993e-46f4-852e-b7a576d2b5bb+9:2363:x1872792608943872:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 54us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034642.439416:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 23 00000100:00100000:0.0:1786034642.439429:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 24 00000100:00100000:0.0:1786034642.439435:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c13892d0-993e-46f4-852e-b7a576d2b5bb+8:2363:x1872792608943744:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034642.439443:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034642.439451:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f1e00/0x490975051af3fc75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b75858d expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034642.439462:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034642.439478:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c13892d0-993e-46f4-852e-b7a576d2b5bb+7:2363:x1872792608943744:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 43us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034642.439484:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 24 00000100:00100000:3.0:1786034642.440031:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608944128 00000100:00100000:3.0:1786034642.440037:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608944128 00000100:00100000:3.0:1786034642.440159:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 241 00000100:00100000:3.0:1786034642.440166:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+6:2361:x1872792608944128:12345-192.168.203.56@tcp:39:umount.0 00000020:00000080:3.0:1786034642.440195:0:5863:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fc83 00000020:00010000:3.0:1786034642.440201:0:5863:0:(genops.c:1942:obd_stale_export_put()) Put export ffff964548b35800: total 0 00000100:00080000:3.0:1786034642.440205:0:5863:0:(import.c:65:import_set_state_nolock()) ffff964548b36800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786034642.440223:0:5863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1786034642.440580:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46043387-e7a3-40ab-b2ac-2e46aee761ed+5:2361:x1872792608944128:12345-192.168.203.56@tcp:39:umount.0 Request processed in 414us (1643us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1786034642.440588:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 241 00000100:00080000:2.0:1786034642.441111:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1786034642.441166:0:7670:0:(genops.c:1928:obd_stale_export_get()) Get export ffff964548b35800: total 0 00010000:00010000:1.0:1786034642.441171:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034642.441208:0:7670:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff964548b35800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1786034642.441235:0:7670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff964547ee4800) 00010000:00010000:1.0:1786034642.441239:0:7670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786034642.441245:0:7670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964574d01000/0x490975051af40bb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589c3 expref: 4 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034642.441265:0:7670:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff964548b35800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1786034642.441274:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034642.441276:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034642.441278:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034642.475655:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034642.475764:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608944384 00000100:00100000:3.0:1786034642.475774:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608944384 00000100:00100000:3.0:1786034642.475857:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 330 00000100:00100000:3.0:1786034642.475867:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+7:2361:x1872792608944384:12345-192.168.203.56@tcp:251:umount.0 00000020:00000080:3.0:1786034642.475915:0:5853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fb79 00000020:00010000:3.0:1786034642.475932:0:5853:0:(genops.c:1942:obd_stale_export_put()) Put export ffff964548b36000: total 0 00000100:00080000:3.0:1786034642.475937:0:5853:0:(import.c:65:import_set_state_nolock()) ffff964548b37000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1786034642.476004:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c13892d0-993e-46f4-852e-b7a576d2b5bb+3:2361:x1872792608944384:12345-192.168.203.56@tcp:251:umount.0 Request processed in 139us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034642.476013:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 330 00000020:00010000:1.0:1786034642.476387:0:5849:0:(genops.c:1928:obd_stale_export_get()) Get export ffff964548b36000: total 0 00010000:00010000:1.0:1786034642.476433:0:5849:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff964548b36000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1786034642.476466:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964574d00600/0x490975051af3fbcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758555 expref: 2 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034642.476480:0:5849:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff964548b36000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1786034642.476489:0:5849:0:(genops.c:906:class_export_put()) final put ffff964548b36000/c13892d0-993e-46f4-852e-b7a576d2b5bb 00010000:00010000:1.0:1786034642.476506:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034642.476508:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034642.476510:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786034642.476549:0:10438:0:(genops.c:865:class_export_destroy()) destroying export ffff964548b36000/c13892d0-993e-46f4-852e-b7a576d2b5bb for MGS 00000020:00000080:2.0:1786034642.476585:0:10438:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff964548b37000 for MGS 00010000:00010000:1.0:1786034642.607962:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034643.633061:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034644.530147:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636192384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034644.530214:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034644.531912:0:6723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636192384 00000100:00100000:1.0:1786034644.531934:0:6723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636192384 00000100:00100000:1.0:1786034644.532002:0:6723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1786034644.532011:0:6723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636192384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786034644.532057:0:6723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034644.532126:0:6723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636192384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034644.532134:0:6723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1786034644.532184:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636192384:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786034644.532387:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786034644.656902:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1786034644.987041:0:12958:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1786034645.005062:0:12958:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1786034645.005118:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.005132:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.005139:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.005145:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.005165:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1786034645.005170:0:12958:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1786034645.005189:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786034645.005194:0:12958:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1786034645.005199:0:12958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1786034645.005229:0:12958:0:(import.c:65:import_set_state_nolock()) ffff964558cf8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1786034645.005299:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872792636192512:0@lo:39:umount.0 00000100:00100000:3.0:1786034645.005357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034645.005490:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636192512 00000100:00100000:2.0:1786034645.005497:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636192512 00000100:00100000:2.0:1786034645.005545:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1786034645.005554:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872792636192512:12345-0@lo:39:umount.0 00000020:00000080:2.0:1786034645.005577:0:5861:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3f996 00000100:00080000:2.0:1786034645.005584:0:5861:0:(import.c:65:import_set_state_nolock()) ffff964574ca4800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1786034645.005645:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3306:x1872792636192512:12345-0@lo:39:umount.0 Request processed in 92us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034645.005652:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1786034645.005660:0:5861:0:(genops.c:906:class_export_put()) final put ffff964574ca6000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1786034645.005681:0:10438:0:(genops.c:865:class_export_destroy()) destroying export ffff964574ca6000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1786034645.005721:0:10438:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff964574ca4800 for lustre-MDT0000 00000100:00080000:2.0:1786034645.005748:0:3306:0:(import.c:65:import_set_state_nolock()) ffff964558cf8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1786034645.005757:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872792636192512:0@lo:39:umount.0 00000100:00080000:2.0:1786034645.005774:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786034645.005777:0:12958:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1786034645.005780:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1786034645.007304:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034645.007312:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034645.007323:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313400 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034645.007326:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034645.007335:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034645.007342:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034645.007347:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1786034645.007350:0:5850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1786034645.007362:0:5850:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1786034645.007392:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034645.007398:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034645.007426:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034645.007434:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964562313400/0x490975051af3fc0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fc13 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034645.007446:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034645.007448:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034645.007449:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034645.007457:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786034645.007469:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636192640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034645.007511:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034645.007552:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636192640 00000100:00100000:0.0:1786034645.007557:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636192640 00000100:00100000:0.0:1786034645.007592:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786034645.007598:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+19:3308:x1872792636192640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786034645.007608:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034645.007620:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964562312600/0x490975051af3fc13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3fc0c expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034645.007631:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034645.007656:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:3308:x1872792636192640:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034645.007663:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786034645.007690:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636192640:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786034645.007952:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034645.009119:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.009130:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.009136:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.009143:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.009171:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786034645.009177:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.009183:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.009189:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.009194:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.009209:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1786034645.009214:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.010324:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786034645.010333:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.010354:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00400 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:1.0:1786034645.010358:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.010365:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786034645.010372:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034645.010378:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1786034645.010381:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1786034645.010409:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.010415:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034645.010734:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034645.010740:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034645.010748:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964541652200 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034645.010751:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034645.010758:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034645.010765:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034645.010770:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1786034645.010773:0:5850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1786034645.010775:0:5850:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1786034645.010792:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034645.010798:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034645.010817:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034645.010841:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964541652200/0x490975051af3fb33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fb3a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.010938:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.010945:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964574d00400/0x490975051af3fc1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fc21 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.010959:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034645.010961:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034645.010963:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034645.010978:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636192768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034645.011035:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034645.011110:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636192768 00000100:00100000:1.0:1786034645.011117:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636192768 00000100:00100000:1.0:1786034645.011168:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786034645.011176:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454acedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+18:3309:x1872792636192768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786034645.011188:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034645.011201:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964582167600/0x490975051af3fc21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3fc1a expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.011214:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786034645.011931:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.011943:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.011951:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.011968:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786034645.011976:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964540031000/0x490975051af3f8e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.011991:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964540031000/0x490975051af3f8e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.011998:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964540031000/0x490975051af3f8e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.012004:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.156@tcp lock: ffff964540031000/0x490975051af3f8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034645.012015:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1786034645.012019:0:12958:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1786034645.012023:0:12958:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1786034645.012050:0:12958:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1786034645.012055:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1786034645.012059:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786034645.012077:0:12958:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1786034645.012083:0:12958:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9644469ad000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1786034645.012088:0:12958:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff964548913000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1786034645.012095:0:12958:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff964548b35800 46043387-e7a3-40ab-b2ac-2e46aee761ed 192.168.203.56@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1786034645.012100:0:12958:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff96457e338000) has exports, disconnecting them 00000020:00080000:2.0:1786034645.012105:0:12958:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9644469ad000), last request at 1786034641 00000020:00000080:2.0:1786034645.012111:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fafb 00000100:00080000:2.0:1786034645.012126:0:12958:0:(import.c:65:import_set_state_nolock()) ffff9644469ab000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1786034645.012171:0:12958:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9644469ad000): rc 0 00000020:00000080:2.0:1786034645.012173:0:12958:0:(genops.c:906:class_export_put()) final put ffff9644469ad000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1786034645.012182:0:12958:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff964548913000), last request at 1786034641 00000020:00000080:2.0:1786034645.012186:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fa30 00000100:00080000:2.0:1786034645.012195:0:12958:0:(import.c:65:import_set_state_nolock()) ffff964548910000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1786034645.012202:0:12958:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff964548913000): rc 0 00000020:00000080:2.0:1786034645.012204:0:12958:0:(genops.c:906:class_export_put()) final put ffff964548913000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1786034645.012211:0:12958:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbe5440d17ae0 00010000:00010000:0.0:1786034645.013110:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786034645.013116:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034645.013136:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313800 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034645.013140:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034645.013148:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034645.013154:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034645.013159:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1786034645.013161:0:5850:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1786034645.013163:0:5850:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1786034645.013189:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034645.013195:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034645.013212:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034645.013219:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964562313800/0x490975051af3fe27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fe2e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034645.013411:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454acedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:3309:x1872792636192768:12345-0@lo:103:ldlm_bl.0 Request processed in 2233us (2372us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034645.013420:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1786034645.013475:0:7670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034645.013480:0:7670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964540031000/0x490975051af3f8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.013487:0:7670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964540031000 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:1.0:1786034645.013491:0:7670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964540031000/0x490975051af3f8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.013498:0:7670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964540031000/0x490975051af3f8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786034645.013505:0:7670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964540031000/0x490975051af3f8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034645.013511:0:7670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1786034645.013513:0:7670:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1786034645.013515:0:7670:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1786034645.013529:0:7670:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964540031000/0x490975051af3f8e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.013545:0:7670:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786034645.013554:0:7670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964540031000/0x490975051af3f8e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.013560:0:7670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964540031000/0x490975051af3f8e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3f8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.013572:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034645.013574:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034645.013575:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034645.013582:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786034645.013590:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9644469ad000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1786034645.013632:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff964548913000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1786034645.013654:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9644469ab000 for lustre-MDT0000 00000020:00000080:1.0:1786034645.013658:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff964548910000 for lustre-MDT0000 00000100:00100000:1.0:1786034645.013670:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636193024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034645.013699:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034645.013750:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636192768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034645.013773:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636193024 00000100:00100000:1.0:1786034645.013778:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636193024 00000100:00100000:1.0:1786034645.013809:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786034645.013818:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:3310:x1872792636193024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786034645.013845:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:2.0:1786034645.013927:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1786034645.013931:0:12958:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1786034645.013943:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1786034645.014004:0:12958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1786034645.014016:0:12958:0:(import.c:65:import_set_state_nolock()) ffff96457645a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1786034645.014027:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1786034645.014029:0:12958:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1786034645.014036:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1786034645.014114:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636193280:0@lo:9:umount.0 00000100:00100000:2.0:1786034645.014145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034645.014172:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636193280 00000100:00100000:2.0:1786034645.014176:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636193280 00000100:00100000:2.0:1786034645.014201:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1786034645.014207:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1872792636193280:12345-0@lo:9:umount.0 00010000:00010000:0.0:1786034645.014432:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034645.014434:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034645.014436:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786034645.015289:0:6720:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fa8b 00000100:00080000:2.0:1786034645.015300:0:6720:0:(import.c:65:import_set_state_nolock()) ffff96457d445000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786034645.015332:0:6720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1786034645.015636:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3306:x1872792636193280:12345-0@lo:9:umount.0 Request processed in 1426us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034645.015645:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1786034645.015681:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96457645a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1786034645.015686:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1786034645.015688:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1786034645.015692:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636193280:0@lo:9:umount.0 00000100:00080000:2.0:1786034645.015710:0:12958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1786034645.015730:0:12958:0:(import.c:65:import_set_state_nolock()) ffff9644469ab800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1786034645.015748:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636193408:0@lo:9:umount.0 00000100:00100000:2.0:1786034645.015775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034645.015807:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636193408 00000100:00100000:2.0:1786034645.015812:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636193408 00010000:00010000:1.0:1786034645.016316:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964542df9000/0x490975051af3fe2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3fe27 expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.016331:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034645.016367:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3310:x1872792636193024:12345-0@lo:103:ldlm_bl.0 Request processed in 2550us (2667us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034645.016375:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1786034645.016398:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034645.016584:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636193152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034645.016615:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034645.016640:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786034645.016652:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636192896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034645.016674:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034645.017320:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3310:1872792636193024:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1786034645.017455:0:12958:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff96457e338000) has no exports 00000100:00100000:2.0:1786034645.017526:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1786034645.017537:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1872792636193408:12345-0@lo:9:umount.0 00000020:00000080:2.0:1786034645.017556:0:6721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fb64 00000100:00080000:2.0:1786034645.017563:0:6721:0:(import.c:65:import_set_state_nolock()) ffff964551854800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786034645.017586:0:6721:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1786034645.017820:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3306:x1872792636193408:12345-0@lo:9:umount.0 Request processed in 286us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034645.017840:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786034645.017942:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636193152 00000100:00100000:1.0:1786034645.017947:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636193152 00000100:00100000:1.0:1786034645.017978:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636192896 00000100:00100000:1.0:1786034645.017982:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636192896 00000100:00100000:1.0:1786034645.017998:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786034645.018005:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+17:3307:x1872792636193152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786034645.018014:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034645.018026:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964562312e00/0x490975051af3f8ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3f8e7 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.018039:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034645.018079:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+16:3307:x1872792636193152:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034645.018085:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786034645.018098:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786034645.018104:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+15:3307:x1872792636192896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786034645.018112:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034645.018120:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964582167c00/0x490975051af3fb3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3fb33 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034645.018130:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034645.018149:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:3307:x1872792636192896:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034645.018154:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1786034645.018183:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034645.018210:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636192896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034645.018218:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636193152:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1786034645.020307:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786034645.020341:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9644469ab800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1786034645.020357:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1786034645.020359:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1786034645.020363:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636193408:0@lo:9:umount.0 00000020:00080000:1.0:1786034645.041288:0:12958:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff96457e338000) has no exports 00000020:00000080:1.0:1786034645.120038:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3f942 00000020:00000080:1.0:1786034645.120053:0:12958:0:(genops.c:906:class_export_put()) final put ffff96457642b800/lustre-QMT0000_UUID 00000020:01000000:1.0:1786034645.120079:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1786034645.120178:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786034645.120188:0:12958:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786034645.120192:0:12958:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff964551918000) has no exports 00000020:00000080:2.0:1786034645.120388:0:10438:0:(genops.c:865:class_export_destroy()) destroying export ffff96457642b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1786034645.120591:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3f93b 00000020:00000080:0.0:1786034645.120596:0:12958:0:(genops.c:906:class_export_put()) final put ffff96457d1ba000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786034645.120648:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786034645.120656:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1786034645.120658:0:12958:0:(genops.c:906:class_export_put()) final put ffff96457d1bf800/lustre-QMT0000_UUID 00000020:00000080:0.0:1786034645.120661:0:12958:0:(genops.c:865:class_export_destroy()) destroying export ffff96457d1bf800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1786034645.120668:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1786034645.120800:0:10438:0:(genops.c:865:class_export_destroy()) destroying export ffff96457d1ba000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1786034645.680028:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786034646.107433:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 46043387-e7a3-40ab-b2ac-2e46aee761ed 00000001:00080000:1.0:1786034646.107449:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1786034646.107455:0:5883:0:(genops.c:906:class_export_put()) final put ffff964548b35800/46043387-e7a3-40ab-b2ac-2e46aee761ed 00000020:00000080:1.0:1786034646.107472:0:10438:0:(genops.c:865:class_export_destroy()) destroying export ffff964548b35800/46043387-e7a3-40ab-b2ac-2e46aee761ed for lustre-MDT0000 00000020:00000080:1.0:1786034646.107528:0:10438:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff964548b36800 for lustre-MDT0000 00000001:00100000:2.0:1786034646.141415:0:6746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786034646.141425:0:6746:0:(genops.c:906:class_export_put()) final put ffff96457d443000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786034646.141499:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96457d443000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1786034646.141543:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96457d445000 for lustre-OST0000 00000100:00100000:2.0:1786034646.576283:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636193664:0@lo:400:kworker.0 00000100:00100000:2.0:1786034646.576344:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034646.576398:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786034646.576403:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636193792:0@lo:400:kworker.0 00000100:00100000:2.0:1786034646.576424:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034646.576472:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636193664 00000100:00100000:2.0:1786034646.576480:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636193664 00000100:00100000:2.0:1786034646.576510:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636193792 00000100:00100000:2.0:1786034646.576513:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636193792 00000100:00100000:2.0:1786034646.576530:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1786034646.576536:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1872792636193664:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1786034646.576545:0:5863:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1786034646.576581:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1872792636193664:12345-0@lo:400:kworker.0 Request processed in 44us (237us total) trans 0 rc -107/-107 00000100:00100000:2.0:1786034646.576587:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1786034646.576601:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1786034646.576605:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1872792636193792:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1786034646.576609:0:5863:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1786034646.576630:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1872792636193792:12345-0@lo:400:kworker.0 Request processed in 24us (205us total) trans 0 rc -107/-107 00000100:00100000:2.0:1786034646.576635:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1786034646.576670:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1786034646.576674:0:3309:0:(import.c:65:import_set_state_nolock()) ffff96444507b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1786034646.576678:0:3309:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1786034646.579218:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636193536:0@lo:400:kworker.0 00000100:00100000:0.0:1786034646.579268:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034646.579328:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636193536 00000100:00100000:0.0:1786034646.579335:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636193536 00000100:00100000:0.0:1786034646.579366:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1786034646.579373:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:3308:x1872792636193536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034646.579412:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:117a9d0c-602c-47bd-a536-8de3b3d11e1e+14:3308:x1872792636193536:12345-0@lo:400:kworker.0 Request processed in 40us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034646.579419:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1786034646.579459:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3308:1872792636193536:0@lo:400:kworker.0 00000100:00080000:2.0:1786034646.615208:0:3309:0:(import.c:65:import_set_state_nolock()) ffff96444507b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786034646.615220:0:3309:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 227 00000100:00080000:2.0:1786034646.615229:0:3309:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96444507b800 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:2.0:1786034646.615283:0:3309:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff964574df8a80 x1872792636193920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786034646.615314:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872792636193792:0@lo:400:kworker.0 00000100:00080000:2.0:1786034646.615342:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1786034646.615352:0:3309:0:(import.c:65:import_set_state_nolock()) ffff96444501e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1786034646.615355:0:3309:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1786034646.615359:0:3309:0:(import.c:65:import_set_state_nolock()) ffff96444501e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786034646.615361:0:3309:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 202 00000100:00080000:2.0:1786034646.615365:0:3309:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96444501e000 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:2.0:1786034646.615377:0:3309:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff964574dfb480 x1872792636194048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786034646.615391:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636193664:0@lo:400:kworker.0 00000100:00100000:3.0:1786034646.615723:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1872792636193920:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1786034646.616014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034646.616050:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1872792636194048:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1786034646.616085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034646.616878:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636193920 00000100:00100000:1.0:1786034646.616885:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636193920 00000100:00100000:1.0:1786034646.616914:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636194048 00000100:00100000:1.0:1786034646.616917:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636194048 00000100:00100000:1.0:1786034646.616933:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1786034646.616940:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1872792636193920:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1786034646.616957:0:5863:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1786034646.618084:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1786034646.618090:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1872792636194048:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1786034646.618101:0:5861:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1786034646.618161:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1872792636194048:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 69us (2074us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786034646.618167:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1786034646.618202:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96444501e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786034646.618207:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786034646.618210:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1872792636194048:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:0.0:1786034646.628120:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786034646.628129:0:7682:0:(genops.c:906:class_export_put()) final put ffff964551853800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786034646.628265:0:10438:0:(genops.c:865:class_export_destroy()) destroying export ffff964551853800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1786034646.628317:0:10438:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff964551854800 for lustre-OST0001 00000100:00100000:1.0:1786034646.630102:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1872792636193920:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 13156us (14084us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786034646.630114:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1786034646.631027:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96444507b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786034646.631034:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786034646.631038:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1872792636193920:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1786034646.705986:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1786034647.153357:0:12958:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff964549e8e9c0 - data ffff96457331d870/ffff964542dc0000 00000020:01000000:0.0:1786034647.153521:0:12958:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff964559510900 - data ffff96454209faf8/ffff964575e4d400 00000001:00000004:0.0:1786034647.168426:0:12958:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:1.0:1786034647.323926:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1786034647.323934:0:12958:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1786034647.323957:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786034647.323960:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1786034647.326934:0:6972:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1786034647.326940:0:6972:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1786034647.326965:0:6972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1786034647.328984:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1786034647.328991:0:12958:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1786034647.329368:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786034647.329371:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1786034647.329702:0:8041:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1786034647.329707:0:8041:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1786034647.329718:0:8041:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1786034647.519188:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3f90a 00000020:00000080:1.0:1786034647.519199:0:12958:0:(genops.c:906:class_export_put()) final put ffff964549e97000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786034647.520150:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff964549e97000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1786034647.523123:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3f91f 00000020:00000080:1.0:1786034647.523133:0:12958:0:(genops.c:906:class_export_put()) final put ffff964549e92000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1786034647.523181:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1786034647.523187:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786034647.523195:0:12958:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1786034647.523200:0:12958:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff96457e33b380) has no exports 00000004:01000000:1.0:1786034647.523355:0:12958:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1786034647.523362:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fb5d 00000020:00000080:1.0:1786034647.523367:0:12958:0:(genops.c:906:class_export_put()) final put ffff96444507a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786034647.527407:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff964549e92000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1786034647.527485:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1786034647.527495:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786034647.527505:0:12958:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1786034647.527509:0:12958:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff964548a0b380) has no exports 00000020:00000080:1.0:1786034647.527517:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fb56 00000020:00000080:1.0:1786034647.527524:0:12958:0:(genops.c:906:class_export_put()) final put ffff9644469a8800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1786034647.527947:0:12958:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1786034647.527952:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1786034647.527957:0:12958:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1786034647.527962:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786034647.527965:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786034647.528088:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786034647.528095:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786034647.528102:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fa76 00000020:00000080:1.0:1786034647.528107:0:12958:0:(genops.c:906:class_export_put()) final put ffff9644450b0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1786034647.528111:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1786034647.528115:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786034647.528119:0:12958:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1786034647.528121:0:12958:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff964542f4b380) has no exports 00000020:00000080:1.0:1786034647.528137:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fa6f 00000020:00000080:1.0:1786034647.528140:0:12958:0:(genops.c:906:class_export_put()) final put ffff96457645c800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1786034647.528492:0:12958:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1786034647.528496:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1786034647.528498:0:12958:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1786034647.528502:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786034647.528503:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786034647.528532:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786034647.528537:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786034647.528561:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786034647.528564:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786034647.528567:0:12958:0:(genops.c:906:class_export_put()) final put ffff96457c143000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786034647.528570:0:12958:0:(genops.c:865:class_export_destroy()) destroying export ffff96457c143000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1786034647.528575:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786034647.528719:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3f926 00000020:00000080:1.0:1786034647.528723:0:12958:0:(genops.c:906:class_export_put()) final put ffff964549e90000/lustre-MDD0000_UUID 00000020:01000000:1.0:1786034647.528727:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1786034647.528730:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786034647.528733:0:12958:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1786034647.528736:0:12958:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff96457e33cd40) has no exports 00000020:00000080:1.0:1786034647.528752:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786034647.528755:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1786034647.528758:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3f92d 00000020:00000080:1.0:1786034647.528761:0:12958:0:(genops.c:906:class_export_put()) final put ffff964549e93000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1786034647.528768:0:12958:0:(tgt_mount.c:187:server_put_mount()) put mount ffff964559843800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1786034647.528771:0:12958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff964559843800 3 00000020:01000004:1.0:1786034647.528774:0:12958:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff964559843800 from lustre-MDT0000 00000020:00000080:1.0:1786034647.528793:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786034647.528797:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1786034647.528799:0:12958:0:(genops.c:906:class_export_put()) final put ffff964549e92800/lustre-MDT0000_UUID 00000020:00000080:1.0:1786034647.528801:0:12958:0:(genops.c:865:class_export_destroy()) destroying export ffff964549e92800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1786034647.528807:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:2.0:1786034647.529315:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96444507a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1786034647.529324:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9644469a8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1786034647.529329:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9644469ab800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1786034647.529334:0:37:0:(genops.c:906:class_export_put()) final put ffff9644469aa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786034647.529336:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9644469aa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1786034647.529339:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786034647.529376:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9644450b0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1786034647.529380:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96457645c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1786034647.529386:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96457645a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1786034647.529389:0:37:0:(genops.c:906:class_export_put()) final put ffff964576459800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786034647.529391:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff964576459800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1786034647.529396:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000004:1.0:1786034647.529534:0:12958:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1786034647.529539:0:12958:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1786034647.529543:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1786034647.529546:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786034647.529549:0:12958:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1786034647.529555:0:12958:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff96455125f800 117a9d0c-602c-47bd-a536-8de3b3d11e1e 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786034647.529561:0:12958:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff96455191b380) has exports, disconnecting them 00000020:00080000:1.0:1786034647.529565:0:12958:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff96455125f800), last request at 1786034338 00000020:00000080:1.0:1786034647.529577:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3f8cb 00000020:00010000:1.0:1786034647.529581:0:12958:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96455125f800: total 2 00000100:00080000:1.0:1786034647.529584:0:12958:0:(import.c:65:import_set_state_nolock()) ffff96455125d800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1786034647.529685:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff964549e90000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1786034647.529689:0:37:0:(genops.c:906:class_export_put()) final put ffff964549e97800/lustre-MDD0000_UUID 00000020:00000080:2.0:1786034647.529691:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff964549e97800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1786034647.529695:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00080000:1.0:1786034647.529897:0:12958:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96455125f800): rc 0 00000020:00080000:1.0:1786034647.529902:0:12958:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff96455191b380) has no exports 00000020:00000080:2.0:1786034647.530299:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff964549e93000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1786034647.531138:0:5855:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff964542e32c00:5855] 1 exiting: rc = 0 00000020:00010000:3.0:1786034647.531914:0:5849:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96455125f800: total 0 00010000:00010000:3.0:1786034647.531949:0:5849:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96455125f800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1786034647.531977:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964562312000/0x490975051af3fc2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3fc28 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034647.532099:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f1000/0x490975051af3f9e3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3f9dc expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034647.532118:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964574d01400/0x490975051af3fbdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3fbd4 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034647.532129:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964562312400/0x490975051af3fbe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3fbe2 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034647.532140:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964574d00200/0x490975051af3fbf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3fbf0 expref: 5 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034647.532162:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964562313a00/0x490975051af3fc05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3fbfe expref: 4 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034647.532175:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964574d01600/0x490975051af3fe12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3fe0b expref: 3 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034647.532186:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964548aa6200/0x490975051af3fe20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x490975051af3fe19 expref: 2 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034647.532197:0:5849:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96455125f800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1786034647.532209:0:5849:0:(genops.c:906:class_export_put()) final put ffff96455125f800/117a9d0c-602c-47bd-a536-8de3b3d11e1e 00010000:00010000:3.0:1786034647.532224:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034647.532226:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034647.532228:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786034647.532326:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96455125f800/117a9d0c-602c-47bd-a536-8de3b3d11e1e for MGS 00000020:00000080:1.0:1786034647.532359:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96455125d800 for MGS 00000100:00100000:0.0:1786034647.532498:0:5856:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff964542f00e00:5856] 2 exiting: rc = 0 00000100:00100000:0.0:1786034647.532586:0:5853:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff964548a3f000:5853] 0 exiting: rc = 1 00000100:00100000:1.0:1786034647.536970:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.536980:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.536987:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537004:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537010:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537016:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537021:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537117:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537124:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537132:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537137:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537143:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537148:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537154:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537161:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537166:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537172:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537178:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537198:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537204:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537210:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537216:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537221:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537227:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537232:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537238:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537244:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537250:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537256:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537262:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537327:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537336:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537342:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537348:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537353:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537359:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537365:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537370:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537375:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537381:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537386:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537391:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537397:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537402:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537407:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537413:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537418:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537424:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537429:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537434:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537439:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537445:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537450:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537464:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537470:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537475:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537481:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537486:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537491:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537497:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537502:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537507:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537513:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.537519:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1786034647.539598:0:12958:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1786034647.539603:0:12958:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1786034647.541566:0:12958:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96455aae7420 - data ffff96456beea948/ffff964445c4dc00 00000020:01000000:3.0:1786034647.541670:0:12958:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff964542de5780 - data ffff964542159870/ffff964560af3400 00000020:00000080:3.0:1786034647.542486:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3f8af 00000020:00000080:3.0:1786034647.542494:0:12958:0:(genops.c:906:class_export_put()) final put ffff96454adf1800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1786034647.542514:0:12958:0:(tgt_mount.c:187:server_put_mount()) put mount ffff964559843800 from MGS, refs=2 00000020:01000004:3.0:1786034647.542518:0:12958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff964559843800 2 00000020:01000004:3.0:1786034647.542522:0:12958:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff964559843800 from MGS 00000020:00000080:3.0:1786034647.542544:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786034647.542550:0:12958:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1786034647.542553:0:12958:0:(genops.c:906:class_export_put()) final put ffff964549f07800/MGS 00000020:00000080:3.0:1786034647.542555:0:12958:0:(genops.c:865:class_export_destroy()) destroying export ffff964549f07800/MGS for MGS 00000020:01000000:3.0:1786034647.542561:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1786034647.542610:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1786034647.542614:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786034647.542626:0:12958:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1786034647.542633:0:12958:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff964558cff800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786034647.542639:0:12958:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff96455191cd40) has exports, disconnecting them 00000020:00080000:3.0:1786034647.542643:0:12958:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff964558cff800), last request at 1786034340 00000020:00000080:3.0:1786034647.542647:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3f97a 00000020:00080000:3.0:1786034647.542656:0:12958:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff964558cff800): rc 0 00000020:00000080:3.0:1786034647.542661:0:12958:0:(genops.c:906:class_export_put()) final put ffff964558cff800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1786034647.543478:0:10438:0:(genops.c:865:class_export_destroy()) destroying export ffff96454adf1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1786034647.543487:0:10438:0:(genops.c:865:class_export_destroy()) destroying export ffff964558cff800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1786034647.547925:0:12958:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1786034647.547932:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786034647.547937:0:12958:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1786034647.547951:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1786034647.548109:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786034647.548117:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1786034647.548123:0:12958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff964559843800 1 00000020:00000080:2.0:1786034647.548129:0:12958:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3f8a1 00000020:00000080:2.0:1786034647.548137:0:12958:0:(genops.c:906:class_export_put()) final put ffff964549f01000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1786034647.548141:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1786034647.548146:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786034647.548149:0:12958:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1786034647.548152:0:12958:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9645595e0000) has no exports 00000020:00000080:1.0:1786034647.548180:0:10438:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff964558cf8800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1786034647.548186:0:10438:0:(genops.c:906:class_export_put()) final put ffff964558cfe000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1786034647.548189:0:10438:0:(genops.c:865:class_export_destroy()) destroying export ffff964558cfe000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1786034647.548197:0:10438:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1786034647.548248:0:10438:0:(genops.c:865:class_export_destroy()) destroying export ffff964549f01000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1786034647.606404:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786034647.606417:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1786034647.606422:0:12958:0:(genops.c:906:class_export_put()) final put ffff96454aac7800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786034647.606427:0:12958:0:(genops.c:865:class_export_destroy()) destroying export ffff96454aac7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1786034647.606439:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1786034647.606574:0:12958:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff964549f04000 00000020:01000000:2.0:1786034647.606593:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1786034647.606597:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786034647.606602:0:12958:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1786034647.606606:0:12958:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9645595e4d40) has no exports 00000100:00100000:2.0:1786034647.606667:0:5861:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff964542f74400:5861] 0 exiting: rc = 1 00000100:00100000:2.0:1786034647.606759:0:6743:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff964445328c00:6743] 3 exiting: rc = 0 00000100:00100000:2.0:1786034647.606814:0:5862:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff964542f74a00:5862] 1 exiting: rc = 0 00000100:00100000:1.0:1786034647.610243:0:5863:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff96454f532600:5863] 2 exiting: rc = 0 00000100:00100000:2.0:1786034647.610946:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.610953:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.610959:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.610965:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.610971:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.610978:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.610984:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.610989:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.610995:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611000:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611017:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611022:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611037:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611043:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611056:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611062:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611068:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611072:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611077:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611083:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611088:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611093:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611099:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611104:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611110:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611114:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611120:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611126:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611131:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611137:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611144:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611149:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611154:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611159:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611164:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611169:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611174:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611180:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611185:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611190:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611195:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611200:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611206:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611210:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611216:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611228:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611233:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611239:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611244:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611261:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611277:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611284:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611289:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611295:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611300:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611308:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611314:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611319:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611324:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611330:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611335:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611340:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611345:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.611350:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.621969:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff96454f533600:5865] 1 exiting: rc = 0 00000100:00100000:2.0:1786034647.623896:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff964542f74000:5864] 0 exiting: rc = 1 00000100:00100000:2.0:1786034647.623964:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.623972:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.623978:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.623984:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.623990:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.623995:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624001:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624006:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624011:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624017:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624023:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624040:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624046:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624061:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624065:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624085:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624089:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624094:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624099:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624105:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624110:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624114:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624119:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624124:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624129:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624133:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624138:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624143:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624148:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624152:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624156:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624161:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624165:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624169:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624173:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624178:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624182:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624187:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624192:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624197:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624202:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624207:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624211:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624216:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624220:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624225:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624229:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624235:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624239:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624243:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624255:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624260:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624265:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624283:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624297:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624303:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624309:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624314:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624320:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624325:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624330:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624336:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624341:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.624346:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.625238:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff96454f527000:5866] 0 exiting: rc = 1 00000100:00100000:0.0:1786034647.628010:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff96454f527600:5867] 1 exiting: rc = 0 00000100:00100000:2.0:1786034647.629977:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.629986:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.629992:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.629998:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630004:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630021:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630039:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630045:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630060:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630066:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630071:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630076:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630082:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630087:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630093:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630099:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630106:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630126:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630133:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630139:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630145:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630164:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630169:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630174:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630180:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630185:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630190:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630196:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630201:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630217:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630225:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630230:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630236:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630242:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630249:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630254:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630260:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630735:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630746:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630752:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630758:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630780:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630787:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630793:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630798:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630804:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630810:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630815:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630902:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630911:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630917:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630923:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630929:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630948:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630955:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630960:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630972:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630977:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630982:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630989:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.630995:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.631001:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.631007:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.631014:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.660389:0:5868:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff96454f526a00:5868] 0 exiting: rc = 1 00000100:00100000:2.0:1786034647.665314:0:5869:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff96454f527e00:5869] 1 exiting: rc = 0 00000100:00100000:2.0:1786034647.665407:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665414:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665420:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665426:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665432:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665437:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665444:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665449:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665454:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665459:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665464:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665470:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665475:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665480:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665485:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665490:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665495:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665500:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665505:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665510:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665514:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665519:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665523:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665528:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665532:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665537:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665553:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665557:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665562:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665567:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665571:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665576:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665581:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665585:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665591:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665596:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665600:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665605:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665609:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665614:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665618:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665622:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665627:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665631:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665635:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665639:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665644:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665648:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665652:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665656:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665661:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665665:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665669:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665673:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665677:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665681:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665685:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665689:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665693:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665697:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665701:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665711:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665716:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.665720:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.667244:0:5870:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff96454f50cc00:5870] 0 exiting: rc = 1 00000100:00100000:2.0:1786034647.674169:0:5871:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff96454f523a00:5871] 1 exiting: rc = 0 00000100:00100000:2.0:1786034647.674262:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674281:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674286:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674291:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674295:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674300:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674305:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674310:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674315:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674320:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674325:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674329:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674334:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674339:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674344:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674350:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674355:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674361:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674366:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674371:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674376:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674380:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674385:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674390:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674394:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674399:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674404:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674409:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674414:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674419:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674424:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674444:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674448:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674453:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674458:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674464:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674468:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674474:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674479:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674484:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674490:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674495:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674500:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674505:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674510:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674515:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674520:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674525:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674530:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674535:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674540:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674544:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674549:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674554:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674559:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674563:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674568:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674573:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674578:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674583:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674588:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674593:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674598:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.674603:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.675116:0:5873:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff96454f50d400:5873] 1 exiting: rc = 0 00000100:00100000:1.0:1786034647.675182:0:5872:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff96454f50dc00:5872] 0 exiting: rc = 1 00000100:00100000:2.0:1786034647.675924:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.675930:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.675943:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.675948:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.675953:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.675959:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.675964:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.675969:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.675973:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.675978:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.675984:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.675988:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.675993:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.675998:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676003:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676008:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676013:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676018:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676116:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676125:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676130:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676135:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676139:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676144:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676149:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676153:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676158:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676162:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676167:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676171:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676176:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676181:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676185:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676190:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676195:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676200:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676204:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676215:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676219:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676223:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676228:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676233:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676238:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676243:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676248:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676253:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676258:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676262:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676344:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676352:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676357:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676361:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676365:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676370:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676375:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676379:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676383:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676388:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676393:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676397:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676402:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676407:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676411:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034647.676416:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.680544:0:5874:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff96454f66a400:5874] 0 exiting: rc = 1 00000100:00100000:2.0:1786034647.684526:0:5875:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff96454f66aa00:5875] 1 exiting: rc = 0 00000100:00100000:2.0:1786034647.684765:0:5876:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff96454f66bc00:5876] 2 exiting: rc = 0 00000100:00100000:1.0:1786034647.684927:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.684934:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.684940:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.684946:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.684952:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.684972:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.684978:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.684984:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.684990:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.684995:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685000:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685006:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685011:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685016:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685022:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685040:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685045:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685061:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685068:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685073:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685096:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685104:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685111:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685117:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685123:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685128:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685134:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685141:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685147:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685153:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685159:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685165:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685171:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685176:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685182:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685188:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685193:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685199:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685205:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685210:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685222:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685227:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685232:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685238:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685255:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685261:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685365:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685373:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685379:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685384:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685389:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685394:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685400:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685405:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685410:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685416:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685421:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685426:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685431:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685437:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685442:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685447:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685452:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034647.685464:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1786034647.694362:0:12958:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786034647.694375:0:12958:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1786034647.694380:0:12958:0:(genops.c:906:class_export_put()) final put ffff964542f6d800/MDS_uuid 00000020:00000080:1.0:1786034647.694384:0:12958:0:(genops.c:865:class_export_destroy()) destroying export ffff964542f6d800/MDS_uuid for MDS 00000020:01000000:1.0:1786034647.694390:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1786034647.694499:0:12958:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1786034647.747593:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034648.751958:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034649.776965:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034650.800959:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1786034651.643119:0:13112:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1786034651.660938:0:13112:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1786034651.660980:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034651.660996:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034651.661004:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034651.661011:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034651.661040:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1786034651.661045:0:13112:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1786034651.661068:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786034651.661071:0:13112:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1786034651.661076:0:13112:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1786034651.661081:0:13112:0:(import.c:65:import_set_state_nolock()) ffff96444501e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1786034651.661086:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786034651.661087:0:13112:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1786034651.661101:0:13112:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1786034651.661991:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034651.662001:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034651.662006:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034651.662011:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034651.662038:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1786034651.662044:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034651.662050:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034651.662056:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034651.662061:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034651.662360:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1786034651.662365:0:13112:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1786034651.662382:0:13112:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1786034651.662386:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1786034651.662390:0:13112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786034651.662402:0:13112:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1786034651.662406:0:13112:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9645595e19c0) has no exports 00000020:00080000:3.0:1786034651.662428:0:13112:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9645595e19c0) has no exports 00010000:00010000:0.0:1786034651.667839:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786034651.667852:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.667864:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1200 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034651.667869:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.667880:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034651.667889:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034651.667895:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1786034651.667898:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1786034651.667900:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1786034651.667940:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.667947:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034651.667971:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.667979:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af3fbf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fbf7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.668009:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786034651.668012:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.668018:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01e00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034651.668031:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.668038:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034651.668044:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034651.668049:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1786034651.668051:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1786034651.668053:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1786034651.668067:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.668073:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034651.668080:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.668085:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964574d01e00/0x490975051af3fbfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fc05 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.668094:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034651.668098:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.668109:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313c00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034651.668113:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.668119:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034651.668125:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034651.668130:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1786034651.668132:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1786034651.668134:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1786034651.668147:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.668152:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034651.668166:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.668172:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964562313c00/0x490975051af3fe19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x490975051af3fe20 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034651.668181:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034651.668183:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034651.668184:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034651.668204:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636194176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034651.668263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034651.668317:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786034651.668330:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636194304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034651.668353:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034651.668380:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636194432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034651.668399:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034651.668427:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636194176 00000100:00100000:0.0:1786034651.668433:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636194176 00000100:00100000:0.0:1786034651.668460:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636194304 00000100:00100000:0.0:1786034651.668462:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636194304 00000100:00100000:0.0:1786034651.668469:0:7671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636194432 00000100:00100000:0.0:1786034651.668471:0:7671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636194432 00000100:00100000:0.0:1786034651.668481:0:7671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786034651.668487:0:7671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3307:x1872792636194176:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1786034651.668493:0:7671:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786034651 with bad export cookie 5262866304346618059 00000020:01000000:3.0:1786034651.669369:0:13112:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96454ac5e6c0 - data ffff964573322948/ffff9644452c8800 00000020:01000000:3.0:1786034651.669500:0:13112:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff964551889180 - data ffff96456bc401b0/ffff964445be3400 00010000:00010000:1.0:1786034651.669843:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034651.671880:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786034651.671889:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1872792636194304:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1786034651.671910:0:5848:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786034651 with bad export cookie 5262866304346618059 00000100:00100000:1.0:1786034651.671978:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1872792636194304:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (3624us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786034651.671985:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786034651.672005:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786034651.672008:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1872792636194432:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1786034651.672012:0:5848:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786034651 with bad export cookie 5262866304346618059 00000100:00100000:1.0:1786034651.672050:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1872792636194432:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (3650us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786034651.672056:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1786034651.672911:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786034651.676295:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.156@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1786034651.676301:0:3307:0:(import.c:65:import_set_state_nolock()) ffff96454aac3000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1786034651.676306:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1786034651.676526:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.156@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1786034651.678911:0:7671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3307:x1872792636194176:12345-0@lo:103:ldlm_bl.0 Request processed in 10420us (10644us total) trans 0 rc -107/-107 00000100:00100000:0.0:1786034651.678923:0:7671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1786034651.696894:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.156@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1786034651.696900:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1786034651.696909:0:3307:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9644476c2d80 x1872792636194176/t0(0) o103->MGC192.168.203.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1786034667 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034651.696923:0:3307:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9644476c1c00 x1872792636194304/t0(0) o103->MGC192.168.203.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1786034667 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034651.696932:0:3307:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9644476c0000 x1872792636194432/t0(0) o103->MGC192.168.203.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1786034667 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1786034651.696940:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1786034651.696942:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1786034651.696943:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1786034651.701605:0:3309:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96454aac3000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1786034651.701641:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3309:1872792636194432:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1786034651.703964:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786034651.703970:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786034651.703974:0:37:0:(import.c:65:import_set_state_nolock()) ffff96444507b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786034651.703979:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1786034651.703984:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1786034651.703990:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96444507b800 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:0.0:1786034651.704189:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9644476c1880 x1872792636194560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786034651.704265:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1872792636194560:0@lo:38:kworker.0 00000400:00000100:2.0:1786034651.704311:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872792636194560 offset 0 length 520: 4 00000100:00080000:1.0:1786034651.705352:0:3307:0:(import.c:65:import_set_state_nolock()) ffff96454aac3000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786034651.705358:0:3307:0:(import.c:510:import_select_connection()) MGC192.168.203.156@tcp: connect to NID 0@lo last attempt 174 00000100:00080000:1.0:1786034651.705363:0:3307:0:(import.c:624:import_select_connection()) MGC192.168.203.156@tcp: import ffff96454aac3000 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:0.0:1786034651.708987:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9644476c1f80 x1872792636194688/t0(0) o250->MGC192.168.203.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786034651.709050:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3306:1872792636194688:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1786034651.709085:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872792636194688 offset 0 length 520: 4 00000100:00100000:0.0:1786034651.709139:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636194176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034651.709159:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3307:1872792636194304:0@lo:103:ldlm_bl.0 00100000:10000000:3.0:1786034651.719477:0:13112:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1786034651.736122:0:13112:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3f9ff 00000020:00000080:0.0:1786034651.736132:0:13112:0:(genops.c:906:class_export_put()) final put ffff9644450b2000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1786034651.736146:0:13112:0:(tgt_mount.c:187:server_put_mount()) put mount ffff964548917000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1786034651.736150:0:13112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff964548917000 2 00000020:01000004:0.0:1786034651.736153:0:13112:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff964548917000 from lustre-OST0000 00000020:00000080:0.0:1786034651.736183:0:13112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786034651.736192:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1786034651.736195:0:13112:0:(genops.c:906:class_export_put()) final put ffff9644450b1800/lustre-OST0000_UUID 00000020:00000080:0.0:1786034651.736197:0:13112:0:(genops.c:865:class_export_destroy()) destroying export ffff9644450b1800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1786034651.736203:0:13112:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1786034651.736255:0:13112:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1786034651.736259:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1786034651.736263:0:13112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786034651.736267:0:13112:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1786034651.736274:0:13112:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff96444501b800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786034651.736280:0:13112:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9645519a4d40) has exports, disconnecting them 00000020:00080000:0.0:1786034651.736285:0:13112:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff96444501b800), last request at 1786034366 00000020:00000080:0.0:1786034651.736289:0:13112:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fa29 00000020:00080000:0.0:1786034651.736297:0:13112:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96444501b800): rc 0 00000020:00000080:0.0:1786034651.736301:0:13112:0:(genops.c:906:class_export_put()) final put ffff96444501b800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1786034651.737008:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9644450b2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1786034651.737016:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96444501b800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1786034651.737909:0:13112:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1786034651.737914:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786034651.737918:0:13112:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1786034651.737923:0:13112:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786034651.738045:0:13112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786034651.738051:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1786034651.738056:0:13112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff964548917000 1 00000020:00000080:1.0:1786034651.738059:0:13112:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3f9b9 00000020:00000080:1.0:1786034651.738063:0:13112:0:(genops.c:906:class_export_put()) final put ffff964548916000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1786034651.738067:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1786034651.738071:0:13112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786034651.738074:0:13112:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1786034651.738077:0:13112:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9645519199c0) has no exports 00000020:00000080:3.0:1786034651.738842:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96444501e000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1786034651.738849:0:37:0:(genops.c:906:class_export_put()) final put ffff96444501c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1786034651.738851:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96444501c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1786034651.738856:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1786034651.738895:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff964548916000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1786034651.785698:0:13112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786034651.785711:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1786034651.785715:0:13112:0:(genops.c:906:class_export_put()) final put ffff964548912800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1786034651.785719:0:13112:0:(genops.c:865:class_export_destroy()) destroying export ffff964548912800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1786034651.785725:0:13112:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1786034651.785865:0:13112:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff964548911000 00000020:02000400:1.0:1786034651.785918:0:13112:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1786034651.824601:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034652.849908:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034653.877638:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034654.898152:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1786034655.216717:0:13261:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1786034655.231952:0:13261:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1786034655.232032:0:13261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fbdb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034655.232046:0:13261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fbdb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034655.232053:0:13261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fbdb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034655.232060:0:13261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fbdb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034655.232080:0:13261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1786034655.232084:0:13261:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1786034655.232102:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786034655.232111:0:13261:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9644476c1880 x1872792636194560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1786034666 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034655.232126:0:13261:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1786034655.232131:0:13261:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1786034655.232137:0:13261:0:(import.c:65:import_set_state_nolock()) ffff96444507b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1786034655.232160:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786034655.232165:0:13261:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9644476c1880 x1872792636194560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1786034666 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034655.232171:0:13261:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1786034655.232174:0:13261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:1.0:1786034655.232256:0:7670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034655.232262:0:7670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fbdb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034655.232270:0:7670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0c00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:1.0:1786034655.232274:0:7670:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fbdb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034655.232292:0:7670:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x490975051af3fbdb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786034655.232298:0:7670:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x490975051af3fbdb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034655.232303:0:7670:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1786034655.232306:0:7670:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1786034655.232308:0:7670:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1786034655.232319:0:7670:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96454aac3000 00010000:00010000:1.0:1786034655.232323:0:7670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x490975051af3fbdb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034655.232330:0:7670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af3fbd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x490975051af3fbdb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034655.232340:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034655.232341:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034655.232343:0:7670:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034655.232426:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1872792636194560:0@lo:38:kworker.0 00010000:00010000:2.0:1786034655.236137:0:13261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fbe9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034655.236747:0:13261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fbe9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034655.236756:0:13261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fbe9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034655.236764:0:13261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fbe9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034655.236811:0:13261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786034655.236817:0:13261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af3fe12 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034655.236863:0:13261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af3fe12 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034655.236870:0:13261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fe12 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034655.236876:0:13261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x490975051af3fe12 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034655.245322:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786034655.245336:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fbe9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034655.245347:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313e00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:3.0:1786034655.245351:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fbe9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034655.245381:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x490975051af3fbe9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786034655.245389:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x490975051af3fbe9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034655.245394:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786034655.245396:0:5850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1786034655.245408:0:5850:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96454aac3000 00010000:00010000:3.0:1786034655.245412:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x490975051af3fbe9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034655.245418:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964562313e00/0x490975051af3fbe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x490975051af3fbe9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034655.245431:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034655.245434:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fe12 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034655.245440:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7400 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:3.0:1786034655.245442:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x490975051af3fe12 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034655.245448:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x490975051af3fe12 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786034655.245453:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x490975051af3fe12 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034655.245466:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1786034655.245469:0:5850:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1786034655.245473:0:5850:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96454aac3000 00010000:00010000:3.0:1786034655.245475:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x490975051af3fe12 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034655.245482:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034655.245484:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034655.245486:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034655.251155:0:13261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1786034655.251169:0:13261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964548aa7400/0x490975051af3fe0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x490975051af3fe12 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034655.251182:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1786034655.251194:0:13261:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1786034655.251203:0:13261:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1786034655.251206:0:13261:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1786034655.251233:0:13261:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1786034655.251237:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1786034655.251246:0:13261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786034655.251253:0:13261:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1786034655.251257:0:13261:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff964542f48000) has no exports 00000020:00080000:2.0:1786034655.251283:0:13261:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff964542f48000) has no exports 00000020:01000000:2.0:1786034655.256816:0:13261:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff964560e12240 - data ffff964573220000/ffff96457dfb5000 00000020:01000000:3.0:1786034655.257010:0:13261:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff964549e8e240 - data ffff96456ebbf510/ffff964574778c00 00100000:10000000:3.0:1786034655.276094:0:13261:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1786034655.304405:0:13261:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3faca 00000020:00000080:0.0:1786034655.304414:0:13261:0:(genops.c:906:class_export_put()) final put ffff964548b33800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1786034655.304433:0:13261:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96457642c000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1786034655.304437:0:13261:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96457642c000 2 00000020:01000004:0.0:1786034655.304440:0:13261:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96457642c000 from lustre-OST0001 00000020:00000080:0.0:1786034655.304462:0:13261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786034655.304471:0:13261:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1786034655.304473:0:13261:0:(genops.c:906:class_export_put()) final put ffff964548b32800/lustre-OST0001_UUID 00000020:00000080:0.0:1786034655.304476:0:13261:0:(genops.c:865:class_export_destroy()) destroying export ffff964548b32800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1786034655.304482:0:13261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1786034655.304593:0:13261:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 117a9d0c-602c-47bd-a536-8de3b3d11e1e->MGS 00010000:00010000:0.0:1786034655.304607:0:13261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964562312c00/0x490975051af3f9dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x490975051af3f9e3 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034655.304642:0:13261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964562312c00/0x490975051af3f9dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x490975051af3f9e3 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034655.304648:0:13261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1786034655.304650:0:13261:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1786034655.304653:0:13261:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1786034655.304667:0:13261:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96454aac3000 00010000:00010000:0.0:1786034655.304670:0:13261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964562312c00/0x490975051af3f9dc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x490975051af3f9e3 expref: -99 pid: 6717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034655.304683:0:13261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fc28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x490975051af3fc2f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034655.304696:0:13261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fc28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x490975051af3fc2f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034655.304701:0:13261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1786034655.304703:0:13261:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1786034655.304705:0:13261:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1786034655.304714:0:13261:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96454aac3000 00010000:00010000:0.0:1786034655.304716:0:13261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964582167000/0x490975051af3fc28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x490975051af3fc2f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786034655.304730:0:13261:0:(import.c:65:import_set_state_nolock()) ffff96454aac3000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1786034655.304734:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1786034655.304736:0:13261:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1786034655.304738:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1786034655.304741:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1786034655.304750:0:13261:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9644476c1f80 x1872792636194688/t0(0) o250->MGC192.168.203.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1786034661 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1786034655.304773:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1786034655.304776:0:13261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1786034655.304800:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:117a9d0c-602c-47bd-a536-8de3b3d11e1e:3306:1872792636194688:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1786034655.304843:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1786034655.304849:0:13261:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3f8bd 00000020:00000080:0.0:1786034655.304853:0:13261:0:(genops.c:906:class_export_put()) final put ffff964542f6f800/117a9d0c-602c-47bd-a536-8de3b3d11e1e 00000020:01000000:0.0:1786034655.304857:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.156@tcp (flags='') 00000020:00000080:0.0:1786034655.304861:0:13261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786034655.304866:0:13261:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.156@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1786034655.304869:0:13261:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff964542f499c0) has no exports 10000000:01000000:0.0:1786034655.304884:0:5858:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1786034655.304917:0:13261:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.156@tcp: client import never connected 00000100:00080000:0.0:1786034655.304920:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1786034655.304921:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1786034655.304923:0:13261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1786034655.304925:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1786034655.304949:0:13261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786034655.304953:0:13261:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.156@tcp (uuid 117a9d0c-602c-47bd-a536-8de3b3d11e1e) 00000020:01000000:0.0:1786034655.304957:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1786034655.304960:0:13261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786034655.304963:0:13261:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1786034655.304967:0:13261:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9644469a9800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786034655.304972:0:13261:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff96457e3399c0) has exports, disconnecting them 00000020:00080000:0.0:1786034655.304976:0:13261:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9644469a9800), last request at 1786034391 00000020:00000080:0.0:1786034655.304979:0:13261:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3faf4 00000020:00080000:0.0:1786034655.304987:0:13261:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9644469a9800): rc 0 00000020:00000080:0.0:1786034655.304991:0:13261:0:(genops.c:906:class_export_put()) final put ffff9644469a9800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1786034655.306030:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff964548b33800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1786034655.306044:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff964542f6f800/117a9d0c-602c-47bd-a536-8de3b3d11e1e for MGC192.168.203.156@tcp 00000020:00000080:1.0:1786034655.306049:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96454aac3000 for MGC192.168.203.156@tcp 00000020:00000080:1.0:1786034655.306055:0:37:0:(genops.c:906:class_export_put()) final put ffff96455aa94000/117a9d0c-602c-47bd-a536-8de3b3d11e1e 00000020:00000080:1.0:1786034655.306057:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96455aa94000/117a9d0c-602c-47bd-a536-8de3b3d11e1e for MGC192.168.203.156@tcp 00000020:01000000:1.0:1786034655.306061:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.156@tcp (117a9d0c-602c-47bd-a536-8de3b3d11e1e) 00000020:00000080:1.0:1786034655.306292:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9644469a9800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1786034655.306860:0:13261:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1786034655.306870:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786034655.306873:0:13261:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1786034655.306878:0:13261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1786034655.306923:0:7670:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1786034655.307041:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96444507b800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1786034655.307443:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1786034655.307559:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1786034655.307667:0:5845:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff964580a0ac00:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1786034655.307793:0:5844:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff964551b8ea00:5844] 0 exiting: rc = 1 00000100:00100000:1.0:1786034655.307957:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.308167:0:5847:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff964580a0a800:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1786034655.308326:0:5848:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff964580a0bc00:5848] 2 exiting: rc = 0 00000100:00100000:1.0:1786034655.309081:0:7671:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff964444abf600:7671] 3 exiting: rc = 0 00000100:00100000:1.0:1786034655.310917:0:5846:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff964580a0a600:5846] 0 exiting: rc = 1 00000100:00100000:2.0:1786034655.311023:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311031:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311037:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311044:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311050:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311057:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311062:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311067:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311073:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311078:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311084:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311099:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311105:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311111:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311116:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311122:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311127:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311133:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311138:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311143:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311147:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311163:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311168:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311173:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311179:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311184:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311189:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311194:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311200:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311205:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311210:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311225:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311231:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311237:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311242:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311247:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311251:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311256:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311260:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311265:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311270:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311275:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311280:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311284:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311289:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311294:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311305:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311310:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311315:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311320:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311325:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311331:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311336:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311342:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311347:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311352:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311358:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311363:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311369:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311374:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311379:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311384:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311389:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.311395:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1786034655.312392:0:13261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786034655.312400:0:13261:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1786034655.312406:0:13261:0:(genops.c:906:class_export_put()) final put ffff96444507a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1786034655.312410:0:13261:0:(genops.c:865:class_export_destroy()) destroying export ffff96444507a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1786034655.312415:0:13261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1786034655.312451:0:13261:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96457642c000 1 00000020:00000080:1.0:1786034655.312455:0:13261:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af3fa99 00000020:00000080:1.0:1786034655.312460:0:13261:0:(genops.c:906:class_export_put()) final put ffff964551851800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1786034655.312472:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1786034655.312481:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff964551851800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1786034655.312490:0:13261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786034655.312494:0:13261:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1786034655.312498:0:13261:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9645595e3380) has no exports 00000020:00000080:1.0:1786034655.370106:0:13261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786034655.370119:0:13261:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1786034655.370124:0:13261:0:(genops.c:906:class_export_put()) final put ffff96457642c800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1786034655.370129:0:13261:0:(genops.c:865:class_export_destroy()) destroying export ffff96457642c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1786034655.370138:0:13261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1786034655.370339:0:13261:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96457642a800 00000020:01000000:1.0:1786034655.370361:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1786034655.370365:0:13261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786034655.370376:0:13261:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1786034655.370380:0:13261:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9645519a0000) has no exports 00000020:00000080:1.0:1786034655.370402:0:13261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786034655.370407:0:13261:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1786034655.370409:0:13261:0:(genops.c:906:class_export_put()) final put ffff964548912000/OSS_uuid 00000020:00000080:1.0:1786034655.370411:0:13261:0:(genops.c:865:class_export_destroy()) destroying export ffff964548912000/OSS_uuid for OSS 00000020:01000000:1.0:1786034655.370415:0:13261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1786034655.370745:0:5857:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1786034655.370884:0:6720:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff96454ad65c00:6720] 1 exiting: rc = 0 00000100:00100000:2.0:1786034655.370923:0:8676:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff964446995000:8676] 3 exiting: rc = 0 00000100:00100000:2.0:1786034655.370963:0:6721:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff964548a07800:6721] 2 exiting: rc = 0 00000100:00100000:2.0:1786034655.378734:0:12516:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff964444abe600:12516] 4 exiting: rc = 0 00000100:00100000:0.0:1786034655.379344:0:6719:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9645519ffe00:6719] 0 exiting: rc = 1 00000100:00100000:1.0:1786034655.381140:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381149:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381155:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381161:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381167:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381172:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381178:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381183:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381187:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381192:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381196:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381201:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381205:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381219:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381224:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381229:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381233:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381238:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381242:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381247:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381252:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381257:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381261:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381266:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381271:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381275:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381279:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381283:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381301:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381305:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381310:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381314:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381319:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381323:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381328:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381333:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381337:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381342:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381347:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381352:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381356:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381361:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381365:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381369:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381374:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381378:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381382:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381387:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381391:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381396:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381400:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381404:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381409:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381415:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381421:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381426:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381431:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381436:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381441:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381445:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381450:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381454:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381459:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.381470:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382177:0:6723:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff96457d450e00:6723] 1 exiting: rc = 0 00000100:00100000:1.0:1786034655.382240:0:6722:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff96457d450c00:6722] 0 exiting: rc = 1 00000100:00100000:1.0:1786034655.382278:0:10126:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff964548b95a00:10126] 2 exiting: rc = 0 00000100:00100000:1.0:1786034655.382317:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382323:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382328:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382332:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382336:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382341:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382346:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382350:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382354:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382358:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382362:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382366:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382370:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382374:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382378:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382382:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382385:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382389:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382393:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382396:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382401:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382405:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382409:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382413:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382418:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382421:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382426:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382430:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382433:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382437:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382448:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382452:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382457:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382461:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382465:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382470:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382474:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382479:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382484:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382488:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382492:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382496:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382500:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382504:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382508:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382512:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382516:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382520:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382524:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382528:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382532:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382538:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382543:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382547:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382551:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382555:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382560:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382563:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382568:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382572:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382577:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382581:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382585:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.382589:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.383349:0:6726:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff964548a06800:6726] 1 exiting: rc = 0 00000100:00100000:2.0:1786034655.385957:0:6725:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff964548a06200:6725] 0 exiting: rc = 1 00000100:00100000:2.0:1786034655.386114:0:6727:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff964548a07e00:6727] 2 exiting: rc = 0 00000100:00100000:1.0:1786034655.386806:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386813:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386818:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386841:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386856:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386863:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386868:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386873:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386879:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386884:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386889:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386894:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386899:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386910:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386916:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386921:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386926:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386931:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386936:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386941:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386947:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386953:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386958:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386963:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386968:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386973:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386978:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386983:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.386988:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387002:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387009:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387014:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387020:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387027:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387035:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387051:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387056:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387074:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387081:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387086:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387091:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387096:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387101:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387106:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387111:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387117:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387121:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387126:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387132:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387141:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387146:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387151:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387157:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387161:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387167:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387178:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387184:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387195:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387201:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387206:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387221:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387227:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387233:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.387244:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.398239:0:6728:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff964548a07200:6728] 0 exiting: rc = 1 00000100:00100000:2.0:1786034655.398326:0:6729:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff964551124800:6729] 1 exiting: rc = 0 00000100:00100000:2.0:1786034655.398369:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.398375:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.398380:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.398384:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.398389:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.398394:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.398410:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.398414:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.398419:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.398423:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.398428:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400163:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400172:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400177:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400182:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400186:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400191:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400195:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400199:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400203:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400207:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400269:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400275:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400279:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400283:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400288:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400292:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400296:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400300:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400304:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400308:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400312:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400316:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400320:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400323:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400327:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400332:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400337:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400341:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400346:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400350:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400511:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400516:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400521:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400526:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400530:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400535:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400540:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400545:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400549:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400553:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400558:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400563:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400567:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400572:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400576:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400581:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400585:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400589:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400594:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400599:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400604:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400608:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786034655.400612:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.405455:0:6730:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff964574833a00:6730] 0 exiting: rc = 1 00000100:00100000:2.0:1786034655.412089:0:6731:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff964574832200:6731] 1 exiting: rc = 0 00000100:00100000:1.0:1786034655.418341:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418537:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418544:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418550:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418555:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418581:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418588:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418595:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418601:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418607:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418612:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418618:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418623:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418629:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418651:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418658:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418664:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418670:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418675:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418681:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418686:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418691:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418697:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418703:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418712:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418734:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418757:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418763:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418769:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418775:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418782:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418787:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418792:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418799:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418804:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418809:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418814:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.418819:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419301:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419308:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419320:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419326:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419331:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419336:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419341:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419346:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419351:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419356:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419361:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419366:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419382:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419388:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419393:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419398:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419403:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419408:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419413:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419418:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419424:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419429:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419435:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419441:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419446:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786034655.419451:0:13261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1786034655.457548:0:13261:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1786034681.696421:0:13877:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1786034694.105749:0:14338:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1786034694.105756:0:14338:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1786034694.105914:0:14338:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9645751e6000 00000020:01000004:2.0:1786034694.105934:0:14338:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1786034694.105944:0:14338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1786034694.105962:0:14338:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9645595e0000) 00000020:00000080:2.0:1786034694.105980:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1786034694.159312:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1786034694.162388:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1786034694.163808:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 497: rc = 0 00100000:10000000:3.0:1786034694.164594:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 497: rc = 0 00100000:10000000:3.0:1786034694.165078:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1786034694.166768:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 497: rc = 0 00100000:10000000:3.0:1786034694.166970:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 497: rc = 0 00100000:10000000:3.0:1786034694.167077:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 497: rc = 0 00100000:10000000:3.0:1786034694.167620:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 497: rc = 0 00100000:10000000:3.0:1786034694.168326:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 499: rc = 0 00100000:10000000:0.0:1786034694.171860:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 723: rc = 0 00100000:10000000:0.0:1786034694.171968:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 723: rc = 0 00100000:10000000:0.0:1786034694.172386:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 770: rc = 0 00100000:10000000:0.0:1786034694.172763:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 770: rc = 0 00100000:10000000:0.0:1786034694.173092:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 770: rc = 0 00100000:10000000:0.0:1786034694.173346:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 770: rc = 0 00100000:10000000:0.0:1786034694.173589:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 770: rc = 0 00100000:10000000:0.0:1786034694.173874:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 770: rc = 0 00100000:10000000:0.0:1786034694.174146:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 770: rc = 0 00100000:10000000:0.0:1786034694.174407:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 770: rc = 0 00100000:10000000:0.0:1786034694.174665:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:0.0:1786034694.183650:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 770: rc = 0 00100000:10000000:0.0:1786034694.185880:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:0.0:1786034694.186297:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:0.0:1786034694.187584:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 278: rc = 0 00100000:10000000:0.0:1786034694.189388:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 278: rc = 0 00100000:10000000:1.0:1786034694.201346:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 278: rc = 0 00100000:10000000:1.0:1786034694.201662:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 278: rc = 0 00100000:10000000:1.0:1786034694.201957:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 278: rc = 0 00100000:10000000:1.0:1786034694.202216:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 278: rc = 0 00100000:10000000:1.0:1786034694.202464:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 278: rc = 0 00100000:10000000:1.0:1786034694.202718:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 278: rc = 0 00100000:10000000:1.0:1786034694.203011:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 278: rc = 0 00100000:10000000:1.0:1786034694.203272:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 278: rc = 0 00100000:10000000:1.0:1786034694.203505:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 278: rc = 0 00100000:10000000:1.0:1786034694.206609:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 278: rc = 0 00100000:10000000:1.0:1786034694.207359:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 278: rc = 0 00100000:10000000:1.0:1786034694.208034:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 278: rc = 0 00100000:10000000:1.0:1786034694.208386:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 278: rc = 0 00100000:10000000:1.0:1786034694.208812:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 278: rc = 0 00100000:10000000:1.0:1786034694.209104:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 278: rc = 0 00100000:10000000:1.0:1786034694.209383:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 278: rc = 0 00100000:10000000:1.0:1786034694.209659:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 278: rc = 0 00100000:10000000:1.0:1786034694.211321:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 278: rc = 0 00100000:10000000:1.0:1786034694.213624:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 278: rc = 0 00100000:10000000:1.0:1786034694.214021:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 278: rc = 0 00100000:10000000:1.0:1786034694.214279:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 278: rc = 0 00100000:10000000:1.0:1786034694.215783:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 278: rc = 0 00100000:10000000:1.0:1786034694.216068:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 278: rc = 0 00100000:10000000:1.0:1786034694.216366:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 278: rc = 0 00100000:10000000:1.0:1786034694.218589:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 278: rc = 0 00100000:10000000:1.0:1786034694.219634:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 278: rc = 0 00100000:10000000:1.0:1786034694.220613:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 278: rc = 0 00100000:10000000:1.0:1786034694.221103:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 278: rc = 0 00100000:10000000:1.0:1786034694.221352:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 278: rc = 0 00100000:10000000:1.0:1786034694.221627:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 278: rc = 0 00100000:10000000:1.0:1786034694.222052:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 773: rc = 0 00100000:10000000:1.0:1786034694.222559:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1786034694.222733:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 518: rc = 0 00100000:10000000:1.0:1786034694.222951:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1786034694.223019:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 518: rc = 0 00100000:10000000:1.0:1786034694.223213:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1786034694.223281:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 518: rc = 0 00100000:10000000:1.0:1786034694.223631:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1786034694.223694:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 724: rc = 0 00100000:10000000:1.0:1786034694.223925:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1786034694.223991:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 724: rc = 0 00100000:10000000:1.0:1786034694.224177:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1786034694.224243:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 724: rc = 0 00000020:00000080:1.0:1786034694.224579:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1786034694.224589:0:14338:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1786034694.224602:0:14338:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x490975051af40bbe 00000020:01000004:1.0:1786034694.224612:0:14338:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1786034694.224618:0:14338:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1786034694.224624:0:14338:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9645751e6000 from MGS 00000020:01000004:1.0:1786034694.224628:0:14338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1786034694.224640:0:14338:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff964542f499c0) 00000020:00000080:1.0:1786034694.224651:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1786034694.224715:0:14338:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9645751e6000 from MGS, refs=2 00080000:01000000:1.0:1786034694.228718:0:14338:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1786034694.231945:0:14338:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x490975051af40bcc 00000100:00100000:2.0:1786034694.232145:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1786034694.232288:0:14338:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1786034694.232302:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1786034694.233190:0:14338:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1786034694.233198:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1786034694.233960:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786034694.234103:0:14338:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1786034694.234108:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1786034694.234843:0:14338:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1786034694.234851:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1786034694.235194:0:14338:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1786034694.235201:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1786034694.235867:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034694.235871:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034694.235873:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034694.236152:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034694.236154:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034694.236156:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034694.236943:0:14338:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1786034694.241638:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1786034694.254923:0:14338:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1786034694.254948:0:14338:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1786034694.254951:0:14338:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1786034694.259650:0:14347:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1786034694.260706:0:14338:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1786034694.260871:0:14338:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1786034694.261390:0:14338:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1786034694.261787:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786034694.261981:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1786034694.261988:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1786034694.277710:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1786034694.277738:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1786034694.278160:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1786034694.278167:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1786034694.282273:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1786034694.282303:0:14338:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.156@tcp' 00000020:01000004:3.0:1786034694.282306:0:14338:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1786034694.282342:0:14338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.156@tcp (typ=mgc) 00000020:00000080:3.0:1786034694.282359:0:14338:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.156@tcp (ffff9645519a4d40) 00000020:00000080:3.0:1786034694.282378:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1786034694.282486:0:14338:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96454adf3800@MGC192.168.203.156@tcp: add connection 192.168.203.156@tcp at head 00010000:00010000:3.0:1786034694.282664:0:14338:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.156@tcp-0 is initialized 00000040:01000000:3.0:1786034694.282673:0:14338:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.156@tcp ctxt 1 is initialized 10000000:01000000:2.0:1786034694.289227:0:14353:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1786034694.289320:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.156@tcp (uuid e73795d0-2313-4f03-984a-ce7ce1eccbf3) 00000020:00000080:3.0:1786034694.289349:0:14338:0:(genops.c:1406:class_connect()) connect: client e73795d0-2313-4f03-984a-ce7ce1eccbf3, cookie 0x490975051af40bda 00000100:00080000:3.0:1786034694.289366:0:14338:0:(import.c:510:import_select_connection()) MGC192.168.203.156@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786034694.289374:0:14338:0:(import.c:624:import_select_connection()) MGC192.168.203.156@tcp: import ffff96454adf3800 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:3.0:1786034694.289436:0:14338:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96457514d880 x1872792636194816/t0(0) o250->MGC192.168.203.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786034694.289467:0:14338:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e73795d0-2313-4f03-984a-ce7ce1eccbf3->MGS 00000020:01000004:3.0:1786034694.289495:0:14338:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1786034694.289502:0:14338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1786034694.289519:0:14338:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9645519a19c0) 00000020:00000080:3.0:1786034694.289531:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1786034694.293328:0:14352:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1786034694.293576:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3306:1872792636194816:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1786034694.293669:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034694.293819:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636194816 00000100:00100000:2.0:1786034694.293853:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636194816 00000100:00100000:2.0:1786034694.293888:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786034694.293897:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1872792636194816:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1786034694.293930:0:14348:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from e73795d0-2313-4f03-984a-ce7ce1eccbf3@0@lo t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:2.0:1786034694.293960:0:14348:0:(genops.c:1406:class_connect()) connect: client e73795d0-2313-4f03-984a-ce7ce1eccbf3, cookie 0x490975051af40be8 00000100:00080000:2.0:1786034694.294113:0:14348:0:(import.c:65:import_set_state_nolock()) ffff964548b34000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786034694.294180:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+5:3306:x1872792636194816:12345-0@lo:250:mount.lustre.0 Request processed in 282us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034694.294189:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786034694.294287:0:3306:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.156@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1786034694.294297:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.156@tcp: connect to target with instance 0 00000100:00080000:1.0:1786034694.294305:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.156@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1786034694.294310:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1786034694.294314:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96454adf3800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1786034694.294323:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1786034694.294338:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1786034694.294345:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3306:1872792636194816:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1786034694.305524:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786034694.305753:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1786034694.305761:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1786034694.316675:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1786034694.316696:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1786034694.317341:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1786034694.317348:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1786034694.326683:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786034694.327110:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1786034694.327119:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1786034694.327757:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1786034694.327765:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1786034694.386532:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786034694.386785:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1786034694.386792:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1786034694.388762:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1786034694.388775:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1786034694.391516:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786034694.391713:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1786034694.391729:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1786034694.393733:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1786034694.393746:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1786034694.395047:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786034694.395500:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1786034694.395507:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1786034694.402131:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1786034694.402148:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1786034694.402997:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786034694.403209:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1786034694.403215:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1786034694.405007:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1786034694.405020:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1786034694.431121:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786034694.431465:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1786034694.431474:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1786034694.433264:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1786034694.433274:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1786034694.436861:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1786034694.436880:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1786034694.438040:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1786034694.438065:0:14338:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1786034694.438073:0:14338:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.156@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1786034694.438257:0:14338:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.156@tcp ctxt 0 is initialized 00000020:01000004:3.0:1786034694.438297:0:14338:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.156@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1786034694.438302:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1786034694.438304:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786034694.438305:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786034694.438306:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786034694.438308:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786034694.438309:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786034694.438311:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786034694.438313:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786034694.438315:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786034694.438316:0:14338:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786034694.438319:0:14338:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1786034694.438321:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786034694.438322:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786034694.438324:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786034694.438325:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786034694.438326:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786034694.438327:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786034694.438333:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786034694.438334:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786034694.438335:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786034694.438336:0:14338:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786034694.438368:0:14338:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1786034694.438391:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636194944:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1786034694.438579:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034694.438639:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca900 going to sleep for 11 seconds 00000100:00100000:2.0:1786034694.438700:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636194944 00000100:00100000:2.0:1786034694.438708:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636194944 00000100:00100000:2.0:1786034694.438773:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786034694.438783:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+5:14338:x1872792636194944:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1786034694.438863:0:14351:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1786034694.438867:0:14351:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1786034694.438870:0:14351:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1786034694.439526:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1786034694.443132:0:14351:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1786034694.450061:0:14373:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1786034694.450070:0:14373:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1786034694.450073:0:14373:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1786034694.450107:0:14373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1786034694.450474:0:14351:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1786034694.450487:0:14351:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1786034694.458207:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+5:14338:x1872792636194944:12345-0@lo:253:mount.lustre.0 Request processed in 19411us (19614us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034694.458226:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786034694.465133:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636194944:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1786034694.465219:0:14338:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1786034694.465224:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1786034694.465226:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786034694.465227:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786034694.465228:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786034694.465230:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786034694.465231:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786034694.465233:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786034694.465235:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786034694.465236:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786034694.465238:0:14338:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1786034694.465304:0:14338:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9645751e6000 from lustre-MDT0000 10000000:01000000:3.0:1786034694.465340:0:14338:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1786034694.465344:0:14338:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1786034694.465349:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9645519a4d40 10000000:01000000:3.0:1786034694.465355:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786034694.465364:0:14338:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9645519a4d40 from 1 10000000:01000000:3.0:1786034694.465367:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1786034694.466001:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1000/0x490975051af40bef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.466014:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff9645413f1000/0x490975051af40bef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.466049:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff9645413f1000/0x490975051af40bef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034694.466074:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636195072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786034694.466602:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034694.466695:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594cab40 going to sleep for 11 seconds 00000100:00100000:2.0:1786034694.469338:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636195072 00000100:00100000:2.0:1786034694.469353:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636195072 00000100:00100000:2.0:1786034694.469431:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786034694.469443:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+5:14338:x1872792636195072:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786034694.469481:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034694.469506:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964548aa6400/0x490975051af40bf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40bef expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.469538:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964548aa6400/0x490975051af40bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40bef expref: 6 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.469551:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964548aa6400/0x490975051af40bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40bef expref: 6 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.469561:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6400, rc 0) 00000100:00100000:2.0:1786034694.469650:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+6:14338:x1872792636195072:12345-0@lo:101:mount.lustre.0 Request processed in 209us (3049us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034694.469658:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786034694.469878:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636195072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786034694.469899:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff9645413f1000/0x490975051af40bef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40bf6 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.469910:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff9645413f1000/0x490975051af40bef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40bf6 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034694.469998:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636195200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786034694.470031:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034694.470062:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454f5249c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034694.470309:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636195200 00000100:00100000:2.0:1786034694.470314:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636195200 00000100:00100000:2.0:1786034694.470346:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786034694.470353:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+6:14338:x1872792636195200:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786034694.470645:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+6:14338:x1872792636195200:12345-0@lo:501:mount.lustre.0 Request processed in 291us (612us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786034694.470652:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786034694.470728:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636195200:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1786034694.470754:0:14338:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1786034694.470771:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1000/0x490975051af40bef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40bf6 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.470780:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff9645413f1000/0x490975051af40bef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40bf6 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034694.470790:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9645751e6000 10000000:01000000:1.0:1786034694.470795:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1786034694.470799:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9645751e6000 10000000:01000000:1.0:1786034694.470808:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1786034694.470811:0:14338:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9645751e6000 from 1 10000000:01000000:1.0:1786034694.470814:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1786034694.470917:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af40bfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.470926:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af40bfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.470935:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af40bfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034694.470957:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636195328:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786034694.470981:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034694.470996:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454f524540 going to sleep for 11 seconds 00000100:00100000:0.0:1786034694.471176:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636195328 00000100:00100000:0.0:1786034694.471181:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636195328 00000100:00100000:0.0:1786034694.471203:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786034694.471210:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+6:14338:x1872792636195328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786034694.471218:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034694.471231:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df8600/0x490975051af40c04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40bfd expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034694.471248:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df8600/0x490975051af40c04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40bfd expref: 7 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034694.471268:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df8600/0x490975051af40c04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40bfd expref: 7 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034694.471276:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8600, rc 0) 00000100:00100000:0.0:1786034694.471314:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+7:14338:x1872792636195328:12345-0@lo:101:mount.lustre.0 Request processed in 104us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034694.471321:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786034694.471445:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636195328:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786034694.471454:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af40bfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40c04 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.471462:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af40bfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40c04 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034694.471473:0:14338:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1786034694.471477:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af40bfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40c04 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.471484:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964574d01c00/0x490975051af40bfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40c04 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034694.471489:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1786034694.471496:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786034694.471501:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9645751e6000 10000000:01000000:1.0:1786034694.471503:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1786034694.471507:0:14338:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1786034694.471508:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1786034694.471523:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00e00/0x490975051af40c0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.471530:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964574d00e00/0x490975051af40c0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.471538:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964574d00e00/0x490975051af40c0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034694.471550:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636195456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786034694.471574:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034694.471593:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454f524540 going to sleep for 11 seconds 00000100:00100000:0.0:1786034694.471850:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636195456 00000100:00100000:0.0:1786034694.471856:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636195456 00000100:00100000:0.0:1786034694.471874:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786034694.471878:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+7:14338:x1872792636195456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786034694.471886:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034694.471894:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df8800/0x490975051af40c12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40c0b expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034694.471906:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df8800/0x490975051af40c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40c0b expref: 8 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034694.471914:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df8800/0x490975051af40c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40c0b expref: 8 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034694.471920:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8800, rc 0) 00000100:00100000:0.0:1786034694.471959:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+8:14338:x1872792636195456:12345-0@lo:101:mount.lustre.0 Request processed in 78us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034694.471965:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786034694.472244:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636195456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786034694.472255:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964574d00e00/0x490975051af40c0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40c12 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.472262:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964574d00e00/0x490975051af40c0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40c12 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034694.472300:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636195584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786034694.472323:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034694.472339:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454f524540 going to sleep for 11 seconds 00000100:00100000:0.0:1786034694.472380:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636195584 00000100:00100000:0.0:1786034694.472384:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636195584 00000100:00100000:0.0:1786034694.472428:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786034694.472434:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+8:14338:x1872792636195584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786034694.472795:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+9:14338:x1872792636195584:12345-0@lo:501:mount.lustre.0 Request processed in 361us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034694.472802:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786034694.472988:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636195584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786034694.473023:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636195712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786034694.473059:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034694.473078:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454f524540 going to sleep for 11 seconds 00000100:00100000:3.0:1786034694.473184:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636195712 00000100:00100000:3.0:1786034694.473189:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636195712 00000100:00100000:3.0:1786034694.473213:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786034694.473219:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+9:14338:x1872792636195712:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786034694.473555:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+9:14338:x1872792636195712:12345-0@lo:503:mount.lustre.0 Request processed in 335us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034694.473562:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786034694.473744:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636195712:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786034694.485794:0:14374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14374:1872792636195840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034694.485936:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034694.486075:0:14374:0:(client.c:2702:ptlrpc_set_wait()) set ffff96456211f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034694.486136:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636195840 00000100:00100000:3.0:1786034694.486144:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636195840 00000100:00100000:3.0:1786034694.486203:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786034694.486214:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+9:14374:x1872792636195840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034694.486786:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+9:14374:x1872792636195840:12345-0@lo:502:llog_process_th.0 Request processed in 573us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034694.486794:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786034694.487181:0:14374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14374:1872792636195840:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786034694.487222:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786034694.487234:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034694.487237:0:14374:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1786034694.487243:0:14374:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1786034694.487246:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786034694.487264:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff964548a08000) 00000020:00000080:0.0:1786034694.487285:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1786034694.487290:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1786034694.487361:0:14374:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1786034694.487368:0:14374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x490975051af40c20 00000020:00000080:0.0:1786034694.487904:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1786034694.487909:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034694.487913:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034694.487914:0:14374:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1786034694.487917:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786034694.487921:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034694.487922:0:14374:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1786034694.487925:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786034694.487933:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff964548a0cd40) 00000020:00000080:0.0:1786034694.487955:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1786034694.487968:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1786034694.487970:0:14374:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1786034694.487973:0:14374:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1786034694.487979:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1786034694.488023:0:14374:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9645751e6000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1786034694.488037:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff964548a099c0) 00000020:00000080:0.0:1786034694.488045:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1786034694.488091:0:14374:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1786034694.488096:0:14374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x490975051af40c35 00000020:00000080:0.0:1786034694.488185:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1786034694.488191:0:14374:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1786034694.488196:0:14374:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x490975051af40c3c 00080000:01000000:0.0:1786034694.488201:0:14374:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1786034694.488205:0:14374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x490975051af40c43 00010000:00010000:3.0:1786034694.617367:0:14374:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1786034694.619211:0:14374:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:3.0:1786034694.619404:0:14374:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1786034694.621762:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9645519a3380) 00000020:00000080:3.0:1786034694.621787:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1786034694.621895:0:14374:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1786034694.621912:0:14374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x490975051af40c51 00000020:00000080:2.0:1786034694.625974:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1786034694.637271:0:14374:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x490975051af40c58 00000020:00000080:0.0:1786034694.640842:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1786034694.640860:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034694.640868:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034694.640871:0:14374:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1786034694.640874:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786034694.640882:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034694.640883:0:14374:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1786034694.640887:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1786034694.640941:0:14374:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1786034694.640953:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034694.640956:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034694.640957:0:14374:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1786034694.640959:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1786034694.640962:0:14374:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:0.0:1786034694.640964:0:14374:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786034694.640966:0:14374:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786034694.640967:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1786034694.640969:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034694.640971:0:14374:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:0.0:1786034694.640973:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1786034694.640985:0:14374:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1786034694.640990:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034694.640991:0:14374:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1786034694.640995:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1786034694.641001:0:14374:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.156@tcp to nid 0x20000c0a8cb9c (192.168.203.156@tcp) 00000020:01000000:0.0:1786034694.641034:0:14374:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1786034694.641037:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786034694.641055:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff964548a0b380) 00000020:00000080:0.0:1786034694.641076:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1786034694.641081:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1786034694.641162:0:14374:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1786034694.641169:0:14374:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1786034694.641177:0:14374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x490975051af40c66 00010000:00080000:0.0:1786034694.641218:0:14374:0:(ldlm_lib.c:102:import_set_conn()) imp ffff964558c22000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.156@tcp at head 00010000:00010000:0.0:1786034694.641962:0:14374:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1786034694.645001:0:14374:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1786034694.645132:0:14374:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1786034694.648383:0:14374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786034694.648817:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1786034694.648983:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000020:00000080:1.0:1786034694.654652:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786034694.654672:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1786034694.654714:0:14374:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1786034694.654750:0:14374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x490975051af40c6d 00000100:00080000:1.0:1786034694.654763:0:14374:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1786034694.654770:0:14374:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff964558c22000 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:1.0:1786034694.654814:0:14374:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9645412a8e00 x1872792636195968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786034694.654869:0:14374:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1786034694.654946:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786034694.654950:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034694.654952:0:14374:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1786034694.654955:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1786034694.654958:0:14374:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1786034694.654960:0:14374:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786034694.654961:0:14374:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786034694.654962:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1786034694.654965:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034694.654966:0:14374:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1786034694.654968:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786034694.654973:0:14374:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1786034694.654977:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034694.654978:0:14374:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1786034694.654981:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1786034694.654984:0:14374:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.156@tcp to nid 0x20000c0a8cb9c (192.168.203.156@tcp) 00000020:01000000:1.0:1786034694.655032:0:14374:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1786034694.655035:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786034694.655049:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff964542f4cd40) 00000020:00000080:1.0:1786034694.655061:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1786034694.655066:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1786034694.655132:0:14374:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1786034694.655139:0:14374:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1786034694.655146:0:14374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x490975051af40c7b 00010000:00080000:1.0:1786034694.655181:0:14374:0:(ldlm_lib.c:102:import_set_conn()) imp ffff964551259000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.156@tcp at head 00010000:00010000:1.0:1786034694.655376:0:14374:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1786034694.655608:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636195968:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1786034694.655679:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872792636195968 offset 0 length 520: 4 00000040:00080000:3.0:1786034694.656665:0:14378:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1786034694.656671:0:14378:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000040:01000000:1.0:1786034694.657306:0:14374:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1786034694.657332:0:14374:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1786034694.659131:0:14374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786034694.659214:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1786034694.659320:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1786034694.660308:0:14380:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1786034694.660314:0:14380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1786034694.667802:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786034694.668069:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1786034694.668111:0:14374:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1786034694.668135:0:14374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x490975051af40c82 00000100:00080000:1.0:1786034694.668280:0:14374:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1786034694.668288:0:14374:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff964551259000 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:1.0:1786034694.668331:0:14374:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9645412a9880 x1872792636196096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786034694.668395:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636196096:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1786034694.668477:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872792636196096 offset 0 length 520: 4 00000100:00080000:1.0:1786034694.668615:0:14374:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1786034694.668676:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786034694.668682:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034694.668684:0:14374:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1786034694.668687:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786034694.668701:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034694.668703:0:14374:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1786034694.668706:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1786034694.668707:0:14374:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1786034694.668709:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786034694.668712:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034694.668713:0:14374:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1786034694.668715:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786034694.668728:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034694.668730:0:14374:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1786034694.668734:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1786034694.668766:0:14374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14374:1872792636196224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786034694.668859:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034694.668888:0:14374:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454f524240 going to sleep for 11 seconds 00000100:00100000:1.0:1786034694.671353:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636196224 00000100:00100000:1.0:1786034694.671367:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636196224 00000100:00100000:1.0:1786034694.671569:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786034694.671581:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+9:14374:x1872792636196224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786034694.671967:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+9:14374:x1872792636196224:12345-0@lo:502:llog_process_th.0 Request processed in 388us (3107us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034694.671975:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786034694.672083:0:14374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14374:1872792636196224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786034694.672118:0:14374:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786034694.672126:0:14374:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786034694.672129:0:14374:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1786034694.672134:0:14374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1786034694.674353:0:14338:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1786034694.674387:0:14338:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1786034694.674544:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00e00/0x490975051af40c0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40c12 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.674581:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964574d00e00/0x490975051af40c0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40c12 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786034694.674590:0:14338:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9645751e6000 from 1 10000000:01000000:2.0:1786034694.674593:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1786034694.674642:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.674650:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.674663:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034694.674690:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636196352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1786034694.674779:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034694.674839:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff964559db8300 going to sleep for 11 seconds 00000100:00100000:0.0:1786034694.674963:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636196352 00000100:00100000:0.0:1786034694.674972:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636196352 00000100:00100000:0.0:1786034694.675024:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786034694.675035:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+9:14338:x1872792636196352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786034694.675050:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034694.675072:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df8c00/0x490975051af40c90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40c89 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034694.675100:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df8c00/0x490975051af40c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40c89 expref: 10 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034694.675112:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df8c00/0x490975051af40c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40c89 expref: 10 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034694.675122:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8c00, rc 0) 00000100:00100000:0.0:1786034694.675171:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+10:14338:x1872792636196352:12345-0@lo:101:mount.lustre.0 Request processed in 137us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034694.675187:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786034694.675702:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636196352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786034694.675727:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40c90 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.675737:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40c90 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034694.676664:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636196480:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1786034694.676726:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034694.676811:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff964559db8300 going to sleep for 11 seconds 00000100:00100000:1.0:1786034694.679343:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636196480 00000100:00100000:1.0:1786034694.679357:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636196480 00000100:00100000:1.0:1786034694.680355:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786034694.680371:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+10:14338:x1872792636196480:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1786034694.680404:0:14348:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1786034694.680412:0:14348:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1786034694.680648:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+10:14338:x1872792636196480:12345-0@lo:256:mount.lustre.0 Request processed in 281us (3928us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034694.680656:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786034694.680793:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636196480:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1786034694.681537:0:14338:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786034694.681559:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40c90 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.681572:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40c90 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034694.681582:0:14338:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9645751e6000 from 1 10000000:01000000:3.0:1786034694.681585:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786034694.681632:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.681641:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.681653:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034694.681676:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636196608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786034694.681735:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034694.681777:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034694.681939:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636196608 00000100:00100000:1.0:1786034694.681947:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636196608 00000100:00100000:1.0:1786034694.681988:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786034694.681996:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+10:14338:x1872792636196608:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786034694.682009:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034694.682027:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964574d00600/0x490975051af40c9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40c97 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.682050:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d00600/0x490975051af40c9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40c97 expref: 11 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.682061:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964574d00600/0x490975051af40c9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40c97 expref: 11 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.682071:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00600, rc 0) 00000100:00100000:1.0:1786034694.682103:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:14338:x1872792636196608:12345-0@lo:101:mount.lustre.0 Request processed in 107us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034694.682110:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786034694.682185:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636196608:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786034694.682199:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40c9e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.682208:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40c9e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034694.682261:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636196736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786034694.682287:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034694.682310:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034694.682325:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636196736 00000100:00100000:3.0:1786034694.682328:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636196736 00000100:00100000:3.0:1786034694.682345:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786034694.682350:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:14338:x1872792636196736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786034694.684075:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:14338:x1872792636196736:12345-0@lo:501:mount.lustre.0 Request processed in 1720us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034694.684086:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786034694.684782:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636196736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786034694.684869:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636196864:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786034694.684917:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034694.684957:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542a65840 going to sleep for 11 seconds 00000100:00100000:0.0:1786034694.685014:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636196864 00000100:00100000:0.0:1786034694.685022:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636196864 00000100:00100000:0.0:1786034694.685066:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786034694.685075:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:14338:x1872792636196864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786034694.685264:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:14338:x1872792636196864:12345-0@lo:503:mount.lustre.0 Request processed in 190us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034694.685272:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786034694.685682:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636196864:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786034694.686175:0:14382:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14382:1872792636196992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786034694.686217:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034694.686248:0:14382:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542a65840 going to sleep for 11 seconds 00000100:00100000:0.0:1786034694.686340:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636196992 00000100:00100000:0.0:1786034694.686346:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636196992 00000100:00100000:0.0:1786034694.686380:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786034694.686388:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:14382:x1872792636196992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034694.686668:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:14382:x1872792636196992:12345-0@lo:502:llog_process_th.0 Request processed in 280us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034694.686677:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786034694.686940:0:14382:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14382:1872792636196992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786034694.686972:0:14382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786034694.686984:0:14382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034694.686987:0:14382:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1786034694.686995:0:14382:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9645751e6000 00000020:00000080:1.0:1786034694.686998:0:14382:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786034694.687008:0:14382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786034694.687010:0:14382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034694.687012:0:14382:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1786034694.687014:0:14382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786034694.687017:0:14382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034694.687018:0:14382:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1786034694.687021:0:14382:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9645751e6000 00000020:00000080:1.0:1786034694.687024:0:14382:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786034694.687087:0:14382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786034694.687091:0:14382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034694.687092:0:14382:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1786034694.687094:0:14382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786034694.687096:0:14382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034694.687098:0:14382:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1786034694.687101:0:14382:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9645751e6000 00000020:00000080:1.0:1786034694.687103:0:14382:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1786034694.687139:0:14382:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14382:1872792636197120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786034694.687283:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034694.687316:0:14382:0:(client.c:2702:ptlrpc_set_wait()) set ffff964553b890c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034694.688266:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636197120 00000100:00100000:3.0:1786034694.688273:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636197120 00000100:00100000:3.0:1786034694.688305:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786034694.688314:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964445331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:14382:x1872792636197120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786034694.688583:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964445331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:14382:x1872792636197120:12345-0@lo:502:llog_process_th.0 Request processed in 269us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034694.688591:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786034694.688779:0:14382:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14382:1872792636197120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786034694.688811:0:14382:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786034694.688818:0:14382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034694.688820:0:14382:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1786034694.688854:0:14382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1786034694.689216:0:14338:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1786034694.689237:0:14338:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786034694.689259:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40c9e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.689270:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40c9e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034694.689317:0:14338:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1786034694.689320:0:14338:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9645751e6000 10000000:01000000:3.0:1786034694.689323:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9645751e6000 10000000:01000000:3.0:1786034694.689328:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786034694.689335:0:14338:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9645751e6000 from 1 10000000:01000000:3.0:1786034694.689338:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786034694.689370:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af40ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.689380:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af40ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.689390:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af40ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034694.690367:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636197248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786034694.690596:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034694.690638:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645594ca6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034694.690742:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636197248 00000100:00100000:1.0:1786034694.690758:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636197248 00000100:00100000:1.0:1786034694.690805:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786034694.690814:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964445332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:14338:x1872792636197248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786034694.690852:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034694.690868:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964574d01000/0x490975051af40cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40ca5 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.690896:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d01000/0x490975051af40cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40ca5 expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.690907:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964574d01000/0x490975051af40cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40ca5 expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034694.690917:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d01000, rc 0) 00000100:00100000:1.0:1786034694.692543:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964445332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14338:x1872792636197248:12345-0@lo:101:mount.lustre.0 Request processed in 1723us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034694.692553:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786034694.698856:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636197248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786034694.698895:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af40ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40cac expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.698910:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af40ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40cac expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034694.699008:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636197376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786034694.699081:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034694.708746:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff964559db8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034694.709656:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636197376 00000100:00100000:0.0:1786034694.709676:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636197376 00000100:00100000:0.0:1786034694.709749:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786034694.709760:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964445330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14338:x1872792636197376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786034694.710138:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964445330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14338:x1872792636197376:12345-0@lo:501:mount.lustre.0 Request processed in 380us (11056us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034694.712561:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636197376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786034694.712625:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636197504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786034694.712690:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034694.712743:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff964559db8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034694.712838:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786034694.712888:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636197504 00000100:00100000:0.0:1786034694.712894:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636197504 00000100:00100000:0.0:1786034694.712926:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786034694.712935:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14338:x1872792636197504:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786034694.713134:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14338:x1872792636197504:12345-0@lo:503:mount.lustre.0 Request processed in 199us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034694.713140:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786034694.713406:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636197504:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786034694.715973:0:14386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14386:1872792636197632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034694.717043:0:14386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034694.717090:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636197632 00000100:00100000:0.0:1786034694.717099:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636197632 00000100:00100000:0.0:1786034694.717144:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786034694.719256:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14386:x1872792636197632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034694.719921:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14386:x1872792636197632:12345-0@lo:502:llog_process_th.0 Request processed in 681us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034694.719931:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786034694.720011:0:14386:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf900 going to sleep for 11 seconds 00000100:00100000:0.0:1786034694.720041:0:14386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14386:1872792636197632:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1786034694.720119:0:14386:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1786034694.720137:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9645519199c0) 00000020:00000080:0.0:1786034694.720180:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1786034694.720394:0:14386:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9645751e6000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1786034694.720398:0:14386:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9645751e6000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1786034694.720401:0:14386:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9645751e6000 4 00010000:00080000:0.0:1786034694.724714:0:14386:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96457645c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.156@tcp at head 00010000:00010000:0.0:1786034694.735708:0:14386:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1786034694.735864:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1786034694.735914:0:14386:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1786034694.735928:0:14386:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x490975051af40cba 00000100:00080000:0.0:1786034694.735941:0:14386:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786034694.735948:0:14386:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96457645c800 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:0.0:1786034694.735992:0:14386:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9644476c1f80 x1872792636197760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786034694.736048:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872792636197760:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786034694.736133:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034694.740393:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636197760 00000100:00100000:0.0:1786034694.742765:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636197760 00000100:00100000:0.0:1786034694.742842:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786034694.742852:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1872792636197760:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786034694.742959:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1872792636197760:12345-0@lo:38:llog_process_th.0 Request processed in 107us (6825us total) trans 0 rc -11/-11 00000100:00100000:0.0:1786034694.742966:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786034694.743019:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786034694.743031:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96457645c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786034694.743051:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1786034694.743055:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872792636197760:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1786034694.743102:0:14386:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1786034694.745306:0:14386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14386:1872792636197888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034694.745385:0:14386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034694.747178:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636197888 00000100:00100000:0.0:1786034694.747191:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636197888 00000100:00100000:0.0:1786034694.747255:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786034694.747267:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14386:x1872792636197888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786034694.748711:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14386:x1872792636197888:12345-0@lo:502:llog_process_th.0 Request processed in 1442us (3321us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034694.749227:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786034694.749388:0:14386:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cdf900 going to sleep for 11 seconds 00000100:00100000:0.0:1786034694.749559:0:14386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14386:1872792636197888:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1786034694.749609:0:14386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1786034694.752053:0:14338:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1786034694.752087:0:14338:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786034694.752105:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af40ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40cac expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.752118:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff9645413f0000/0x490975051af40ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40cac expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1786034694.752177:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1786034694.752180:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786034694.752182:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034694.752183:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786034694.752189:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034694.752191:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034694.752192:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786034694.752193:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786034694.752195:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034694.752196:0:14338:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786034694.752201:0:14338:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1786034694.752204:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786034694.752205:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786034694.752206:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034694.752207:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786034694.752208:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034694.752209:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034694.752209:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786034694.752210:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786034694.752211:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034694.752212:0:14338:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786034694.752245:0:14338:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1786034694.752268:0:14338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636198016:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786034694.752348:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034694.752393:0:14338:0:(client.c:2702:ptlrpc_set_wait()) set ffff964553aa7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786034694.752814:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636198016 00000100:00100000:0.0:1786034694.752842:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636198016 00000100:00100000:0.0:1786034694.752895:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786034694.752906:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14338:x1872792636198016:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1786034694.752938:0:14348:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1786034694.752955:0:14348:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1786034694.848879:0:14348:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1786034694.848904:0:14348:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1786034694.849038:0:14372:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1786034694.849047:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1786034694.849076:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.849096:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964542df8c00/0x490975051af40c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40c89 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.849119:0:14372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.849164:0:14372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964542df8c00/0x490975051af40c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af40c89 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.849180:0:14372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964542df8c00/0x490975051af40c90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af40c89 expref: 12 pid: 14350 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034694.849196:0:14372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1872792636198144:0@lo:104: 00000100:00100000:3.0:1786034694.849265:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034694.849339:0:14372:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cec240 going to sleep for 11 seconds 00000100:00100000:3.0:1786034694.849391:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636198144 00000100:00100000:3.0:1786034694.849398:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636198144 00000100:00100000:3.0:1786034694.849507:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786034694.849515:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+3:14372:x1872792636198144:12345-0@lo:104: 00010000:00010000:3.0:1786034694.849528:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af40c90 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.850233:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786034694.850241:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+3:14372:x1872792636198144:12345-0@lo:104: Request processed in 727us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034694.850248:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1786034694.850280:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034694.850286:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af40c90 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.850294:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6a00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:3.0:1786034694.850306:0:14345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af40c90 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.850314:0:14345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af40c90 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786034694.850321:0:14345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af40c90 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034694.850326:0:14345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1786034694.850363:0:14345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40c90 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.850370:0:14345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786034694.850394:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40c90 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.850401:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964548aa6a00/0x490975051af40c89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40c90 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034694.850642:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786034694.850664:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3309:1872792636198272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786034694.850738:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034694.850859:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636198272 00000100:00100000:2.0:1786034694.850867:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636198272 00010000:00010000:2.0:1786034694.850897:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964542df8c00/0x490975051af40c90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af40c89 expref: 13 pid: 14350 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034694.850928:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786034694.850947:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+13:3309:x1872792636198272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786034694.850962:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034694.850968:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964542df8c00/0x490975051af40c90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af40c89 expref: 13 pid: 14350 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.850993:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964542df8c00/0x490975051af40c90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af40c89 expref: 13 pid: 14350 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.851017:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.851022:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034694.851027:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034694.851030:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034694.851030:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1786034694.851053:0:14341:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002005966s 00010000:00010000:2.0:1786034694.851058:0:14341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.851068:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.851071:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964542df8c00/0x490975051af40c90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af40c89 expref: 13 pid: 14350 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.851096:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034694.851105:0:14372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1872792636198144:0@lo:104: 00010000:00010000:2.0:1786034694.851112:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.851121:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0e00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:2.0:1786034694.851127:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.851128:0:14372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.851159:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.851169:0:14372:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.851177:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034694.851186:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.851215:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f0e00/0x490975051af40cc1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034694.851238:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034694.851286:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:3309:x1872792636198272:12345-0@lo:103:ldlm_bl.0 Request processed in 349us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034694.851294:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786034694.852030:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3309:1872792636198272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034694.904981:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:14338:x1872792636198016:12345-0@lo:253:mount.lustre.0 Request processed in 152064us (152621us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034694.904999:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786034694.906599:0:14338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14338:1872792636198016:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1786034694.906621:0:14338:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1786034694.906625:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786034694.906627:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786034694.906629:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034694.906630:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786034694.906631:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034694.906633:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034694.906634:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786034694.906636:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786034694.906638:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034694.906640:0:14338:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1786034694.906664:0:14338:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1786034694.928346:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1786034694.928739:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1786034694.929987:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1786034694.930131:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1786034694.931484:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1786034694.931744:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1786034694.935275:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1786034694.936558:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1786034694.936923:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1786034694.937175:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1786034694.937861:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1786034694.938126:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1786034695.092671:0:14338:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1786034695.093232:0:14338:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1786034695.097724:0:14395:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1786034695.097881:0:14395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786034695.101035:0:14395:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1786034695.101126:0:14395:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1786034695.101131:0:14395:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:1.0:1786034695.106519:0:14394:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1786034695.106527:0:14394:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1786034695.111554:0:14338:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1786034695.111848:0:14338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1786034695.112291:0:14338:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1786034695.112298:0:14338:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1786034695.112429:0:14338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786034695.113400:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1786034695.113969:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1786034695.114000:0:14338:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1786034695.127075:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1786034695.146505:0:14338:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1786034695.231802:0:14338:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1786034695.231869:0:14338:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbe5441c87988 00100000:10000000:0.0:1786034695.231876:0:14338:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1786034695.233074:0:14338:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1786034695.233091:0:14338:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.156@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1786034695.233110:0:14338:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1786034695.233127:0:14338:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1786034695.283992:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786034695.603027:0:14353:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1786034695.603038:0:14353:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9645751e6000 from 6 10000000:01000000:3.0:1786034695.603045:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786034695.603110:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034695.603126:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034695.603139:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034695.603260:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636198400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786034695.603349:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034695.603459:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cecb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786034695.607302:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636198400 00000100:00100000:1.0:1786034695.607337:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636198400 00000100:00100000:3.0:1786034695.608510:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786034695.608527:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:14353:x1872792636198400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034695.608550:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034695.608575:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9645413f0e00/0x490975051af40ccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40cc8 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034695.608610:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f0e00/0x490975051af40ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40cc8 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034695.608622:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9645413f0e00/0x490975051af40ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40cc8 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034695.608632:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9645413f0e00, rc 0) 00000100:00100000:3.0:1786034695.608731:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14353:x1872792636198400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (5382us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034695.608738:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786034695.608807:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636198400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034695.608842:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40ccf expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034695.608852:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40ccf expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034695.608928:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636198528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786034695.608979:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034695.609014:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cecb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786034695.609029:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636198528 00000100:00100000:3.0:1786034695.609034:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636198528 00000100:00100000:3.0:1786034695.609067:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786034695.609074:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14353:x1872792636198528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1786034695.609089:0:14348:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1786034695.609107:0:14348:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786034695.609111:0:14348:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1786034695.609183:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14353:x1872792636198528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034695.609191:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786034695.609222:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636198528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1786034695.609264:0:14353:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786034695.609272:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40ccf expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034695.609282:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40ccf expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786034695.793484:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1786034696.309037:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786034696.817192:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786034697.330565:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034698.354210:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034699.376122:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786034699.827353:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786034699.827361:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1786034699.827365:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786034699.827368:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1786034699.827372:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1786034699.827375:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786034699.827380:0:8:0:(import.c:65:import_set_state_nolock()) ffff96457645c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786034699.827396:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96457645c800 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:1.0:1786034699.827422:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9645412ab100 x1872792636198784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786034699.827474:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786034699.827486:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3308:1872792636198656:0@lo:400:kworker.0 00000100:00100000:1.0:1786034699.827572:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034699.827634:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872792636198784:0@lo:38:kworker.0 00000100:00100000:1.0:1786034699.827670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034699.827718:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636198656 00000100:00100000:1.0:1786034699.827726:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636198656 00000100:00100000:1.0:1786034699.827775:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786034699.827784:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:3308:x1872792636198656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034699.827864:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:3308:x1872792636198656:12345-0@lo:400:kworker.0 Request processed in 81us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034699.827872:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786034699.827930:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636198784 00000100:00100000:1.0:1786034699.827934:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636198784 00000100:00100000:1.0:1786034699.827955:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786034699.827961:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1872792636198784:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1786034699.827986:0:14358:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:1.0:1786034699.828029:0:14358:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x490975051af40cd6 00000004:00100000:1.0:1786034699.828047:0:14358:0:(mdt_handler.c:7332:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786034699.828194:0:14358:0:(import.c:65:import_set_state_nolock()) ffff96455125e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786034699.828234:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872792636198784:12345-0@lo:38:kworker.0 Request processed in 272us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034699.828241:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1786034699.828281:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9645412ab100 x1872792636198784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786034709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786034699.828296:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1786034699.828304:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1786034699.828309:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1786034699.828312:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96457645c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1786034699.828318:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872792636198784:0@lo:38:kworker.0 00000100:00100000:1.0:1786034699.828342:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3308:1872792636198656:0@lo:400:kworker.0 00010000:00010000:3.0:1786034700.400142:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786034700.871202:0:14638:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1786034701.425970:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034702.449453:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034703.472905:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786034704.373543:0:14788:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeabf06f40 20000000:00000080:3.0:1786034704.373566:0:14788:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff964550762800 uarg=0000000000000000 20000000:01000000:3.0:1786034704.373608:0:14788:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1786034704.373617:0:14788:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1786034704.373623:0:14788:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1786034704.381727:0:14789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1786034704.384550:0:14788:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1786034704.406010:0:14788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1786034704.406317:0:14788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.406395:0:14788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964574d00600/0x490975051af40c9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40c97 expref: 11 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.406421:0:14788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.406465:0:14788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964574d00600/0x490975051af40c9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af40c97 expref: 11 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.406478:0:14788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964574d00600/0x490975051af40c9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af40c97 expref: 11 pid: 14351 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034704.406493:0:14788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14788:1872792636198912:0@lo:104: 00000100:00100000:1.0:1786034704.406549:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034704.406600:0:14788:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454f51a480 going to sleep for 11 seconds 00000100:00100000:3.0:1786034704.406688:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636198912 00000100:00100000:3.0:1786034704.406695:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636198912 00000100:00100000:3.0:1786034704.406747:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786034704.406755:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+3:14788:x1872792636198912:12345-0@lo:104: 00010000:00010000:3.0:1786034704.406767:0:14340:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af40c9e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034704.406854:0:14340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786034704.406861:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+3:14788:x1872792636198912:12345-0@lo:104: Request processed in 107us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034704.406868:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786034704.406934:0:14788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14788:1872792636198912:0@lo:104: 00010000:00010000:2.0:1786034704.406968:0:14788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034704.407988:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034704.407998:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af40c9e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034704.408010:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0800 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034704.408016:0:14345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af40c9e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034704.408028:0:14345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af40c9e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034704.408037:0:14345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af40c9e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034704.408043:0:14345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786034704.408100:0:14345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40c9e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034704.408118:0:14345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034704.408148:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40c9e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034704.408156:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff9645413f0800/0x490975051af40c97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40c9e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034704.408180:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034704.408183:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034704.408185:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034704.408196:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786034704.408214:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3307:1872792636199040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034704.408284:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034704.408410:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636199040 00000100:00100000:1.0:1786034704.408418:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636199040 00010000:00010000:1.0:1786034704.408448:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964574d00600/0x490975051af40c9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af40c97 expref: 12 pid: 14351 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034704.408479:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786034704.408486:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:3307:x1872792636199040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786034704.408497:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034704.408503:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964574d00600/0x490975051af40c9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af40c97 expref: 12 pid: 14351 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.408516:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964574d00600/0x490975051af40c9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af40c97 expref: 12 pid: 14351 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.408532:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964574d00600/0x490975051af40c9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af40c97 expref: 12 pid: 14351 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.408560:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.408568:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.408582:0:14341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.408588:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.408595:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.408601:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.408608:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034704.408613:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.408620:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.408647:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034704.408667:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786034704.408686:0:14788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034704.408699:0:14788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034704.408708:0:14788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964574d01400/0x490975051af40cdd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034704.408786:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:3307:x1872792636199040:12345-0@lo:103:ldlm_bl.0 Request processed in 299us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034704.408800:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786034704.412926:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3307:1872792636199040:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786034704.498045:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786034704.947836:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786034704.947843:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1786034704.947847:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786034704.947850:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1786034704.949733:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3309:1872792636199168:0@lo:400:kworker.0 00000100:00100000:2.0:1786034704.949800:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034704.949979:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636199296:0@lo:400:kworker.0 00000100:00100000:3.0:1786034704.950019:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034704.955777:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636199296 00000100:00100000:1.0:1786034704.955789:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636199296 00000100:00100000:1.0:1786034704.955846:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786034704.955855:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636199296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034704.955927:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872792636199296:12345-0@lo:400:kworker.0 Request processed in 74us (5907us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034704.955933:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786034704.955996:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786034694/real 1786034694] req@ffff9645412a9880 x1872792636196096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786034704 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034704.956015:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9645412a9880 x1872792636196096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786034704 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034704.956026:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786034694/real 1786034694] req@ffff9645412a8e00 x1872792636195968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786034704 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034704.956037:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9645412a8e00 x1872792636195968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786034704 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786034704.956050:0:3306:0:(import.c:65:import_set_state_nolock()) ffff964551259000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786034704.956059:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1786034704.956074:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636196096:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1786034704.956080:0:3306:0:(import.c:65:import_set_state_nolock()) ffff964558c22000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786034704.956085:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1786034704.956088:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636195968:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1786034704.956190:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636199168 00000100:00100000:2.0:1786034704.956195:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636199168 00000100:00100000:2.0:1786034704.956228:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786034704.956235:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:3309:x1872792636199168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034704.956267:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:3309:x1872792636199168:12345-0@lo:400:kworker.0 Request processed in 34us (6467us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034704.956273:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786034704.956319:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3309:1872792636199168:0@lo:400:kworker.0 00010000:00080000:3.0:1786034704.957001:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96457514dc00 x1872792636199296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034704.957013:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872792636199296:0@lo:400:kworker.0 00000100:00080000:2.0:1786034704.962754:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786034704.962764:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1786034704.962768:0:8:0:(import.c:65:import_set_state_nolock()) ffff964558c22000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786034704.962775:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 530 00000100:00080000:2.0:1786034704.962780:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786034704.962787:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff964558c22000 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:2.0:1786034704.962962:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff964574df9180 x1872792636199424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786034704.963012:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636199424:0@lo:8:kworker.0 00000400:00000100:1.0:1786034704.963063:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872792636199424 offset 0 length 520: 4 00000100:00080000:2.0:1786034704.965477:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786034704.965484:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1786034704.965487:0:8:0:(import.c:65:import_set_state_nolock()) ffff964551259000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786034704.965492:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 530 00000100:00080000:2.0:1786034704.965496:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786034704.965501:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff964551259000 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:2.0:1786034704.965526:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff964574dfaa00 x1872792636199552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786034704.967896:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636199552:0@lo:8:kworker.0 00000400:00000100:1.0:1786034704.967946:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872792636199552 offset 0 length 520: 4 00010000:00010000:0.0:1786034705.526229:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1786034705.526294:0:14353:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786034705.526299:0:14353:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9645751e6000 from 10 10000000:01000000:1.0:1786034705.526306:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786034705.526365:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034705.526380:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034705.526394:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034705.526426:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636199680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786034705.527217:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034705.527331:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cecb40 going to sleep for 11 seconds 00000100:00100000:0.0:1786034705.537912:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636199680 00000100:00100000:0.0:1786034705.537930:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636199680 00000100:00100000:0.0:1786034705.538035:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786034705.538047:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+11:14353:x1872792636199680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786034705.538068:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034705.538092:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df9c00/0x490975051af40ceb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40ce4 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034705.538124:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df9c00/0x490975051af40ceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40ce4 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034705.538145:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df9c00/0x490975051af40ceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40ce4 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034705.538156:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9c00, rc 0) 00000100:00100000:0.0:1786034705.538258:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14353:x1872792636199680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (11042us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034705.538266:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786034705.538352:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636199680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034705.538375:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40ceb expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034705.538385:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40ceb expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034705.538478:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636199808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034705.538528:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034705.551577:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560bd6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786034705.551848:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636199808 00000100:00100000:2.0:1786034705.551859:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636199808 00000100:00100000:2.0:1786034705.553393:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786034705.553406:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14353:x1872792636199808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034705.553768:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14353:x1872792636199808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 363us (15238us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034705.553777:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786034705.553845:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636199808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034705.553901:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636199936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786034705.553950:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034705.553962:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff964542f23180 going to sleep for 11 seconds 00000100:00100000:2.0:1786034705.553978:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636199936 00000100:00100000:2.0:1786034705.553983:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636199936 00000100:00100000:2.0:1786034705.554019:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786034705.554043:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14353:x1872792636199936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786034705.554200:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:14353:x1872792636199936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034705.554207:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786034705.554237:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636199936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786034705.563291:0:14833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1786034705.563577:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1786034705.563604:0:14353:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786034705.563617:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40ceb expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034705.563631:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40ceb expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786034706.033589:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1786034706.544993:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034707.570931:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034708.593024:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034709.637313:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786034710.064407:0:10438:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786034710.064415:0:10438:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1786034710.064418:0:10438:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786034710.064422:0:10438:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1786034710.064463:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636200192:0@lo:400:kworker.0 00000100:00100000:2.0:1786034710.064553:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034710.064632:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786034710.064640:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3308:1872792636200064:0@lo:400:kworker.0 00000100:00100000:2.0:1786034710.064674:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034710.064716:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636200192 00000100:00100000:2.0:1786034710.064724:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636200192 00000100:00100000:2.0:1786034710.064789:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786034710.064798:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636200192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034710.064877:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636200192:12345-0@lo:400:kworker.0 Request processed in 80us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034710.064885:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786034710.064910:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636200064 00000100:00100000:2.0:1786034710.064913:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636200064 00000100:00100000:2.0:1786034710.064934:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786034710.064940:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:3308:x1872792636200064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034710.064966:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:3308:x1872792636200064:12345-0@lo:400:kworker.0 Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034710.064972:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786034710.065017:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3308:1872792636200064:0@lo:400:kworker.0 00010000:00080000:2.0:1786034710.065031:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff964574dfb100 x1872792636200192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034710.065043:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636200192:0@lo:400:kworker.0 00010000:00010000:1.0:1786034710.641635:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1786034711.580300:0:15037:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1786034711.580306:0:15037:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1786034711.580441:0:15037:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9645747a5000 00000020:01000004:0.0:1786034711.580461:0:15037:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1786034711.580489:0:15037:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1786034711.580506:0:15037:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96455191cd40) 00000020:00000080:0.0:1786034711.580526:0:15037:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1786034711.632229:0:15037:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1786034711.633164:0:15037:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1786034711.636124:0:15037:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1786034711.637899:0:15037:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1786034711.638148:0:15037:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1786034711.639293:0:15037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1786034711.644524:0:15037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1786034711.644655:0:15037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1786034711.646031:0:15037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 441: rc = 0 00100000:10000000:2.0:1786034711.648506:0:15037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 441: rc = 0 00100000:10000000:3.0:1786034711.649153:0:15037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 441: rc = 0 00100000:10000000:3.0:1786034711.650264:0:15037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 441: rc = 0 00100000:10000000:3.0:1786034711.650534:0:15037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 441: rc = 0 00100000:10000000:3.0:1786034711.650816:0:15037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 441: rc = 0 00000020:00000080:3.0:1786034711.652995:0:15037:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1786034711.653009:0:15037:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786034711.653024:0:15037:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x490975051af40cf9 00000020:01000004:3.0:1786034711.653034:0:15037:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1786034711.653057:0:15037:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1786034711.653061:0:15037:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1786034711.653066:0:15037:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1786034711.653071:0:15037:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1786034711.653085:0:15037:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9645519a0000) 00000020:00000080:3.0:1786034711.653098:0:15037:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1786034711.662518:0:15037:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786034711.662723:0:15037:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1786034711.662730:0:15037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00010000:00010000:3.0:1786034711.664973:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034711.665154:0:15037:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1786034711.665165:0:15037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1786034711.673800:0:15037:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1786034711.673846:0:15037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1786034711.675934:0:15037:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786034711.676117:0:15037:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1786034711.676123:0:15037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1786034711.679443:0:15037:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1786034711.679455:0:15037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1786034711.724738:0:15037:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786034711.727775:0:15037:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1786034711.727784:0:15037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1786034711.729656:0:15037:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1786034711.729669:0:15037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1786034711.735966:0:15037:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1786034711.735989:0:15037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1786034711.742296:0:15037:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786034711.743265:0:15037:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1786034711.743273:0:15037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1786034711.745509:0:15037:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1786034711.745523:0:15037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1786034711.848563:0:15037:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786034711.848805:0:15037:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1786034711.848813:0:15037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1786034711.872535:0:15037:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1786034711.872565:0:15037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1786034711.886682:0:15037:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1786034711.886730:0:15037:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1786034711.886738:0:15037:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1786034711.912053:0:15037:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786034711.912110:0:15037:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.156@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1786034711.912116:0:15037:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786034711.912118:0:15037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786034711.912119:0:15037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034711.912121:0:15037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786034711.912122:0:15037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034711.912124:0:15037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034711.912126:0:15037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786034711.912128:0:15037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034711.912129:0:15037:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786034711.912133:0:15037:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1786034711.912135:0:15037:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786034711.912137:0:15037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786034711.912138:0:15037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034711.912139:0:15037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786034711.912140:0:15037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034711.912141:0:15037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034711.912152:0:15037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786034711.912158:0:15037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034711.912159:0:15037:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786034711.912191:0:15037:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1786034711.912216:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636200320:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786034711.912302:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034711.912364:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454ad06000 going to sleep for 11 seconds 00000100:00100000:1.0:1786034711.912530:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636200320 00000100:00100000:1.0:1786034711.912539:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636200320 00000100:00100000:1.0:1786034711.912609:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786034711.912620:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:15037:x1872792636200320:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1786034711.912670:0:14348:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1786034711.912673:0:14348:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1786034711.912678:0:14348:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1786034711.966673:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:15037:x1872792636200320:12345-0@lo:253:mount.lustre.0 Request processed in 54044us (54359us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034711.966692:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786034711.966893:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636200320:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1786034711.966912:0:15037:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1786034711.966916:0:15037:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786034711.966918:0:15037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786034711.966920:0:15037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034711.966921:0:15037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786034711.966922:0:15037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034711.966924:0:15037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034711.966925:0:15037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786034711.966927:0:15037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034711.966928:0:15037:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1786034711.966956:0:15037:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9645747a5000 from lustre-OST0000 10000000:01000000:2.0:1786034711.966989:0:15037:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1786034711.966993:0:15037:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1786034711.967001:0:15037:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9645519a4d40 local copy 00010000:00010000:2.0:1786034711.967014:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1000/0x490975051af40bef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40bf6 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034711.967319:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636200448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786034711.967358:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034711.967657:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560bd6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786034711.967728:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636200448 00000100:00100000:0.0:1786034711.967736:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636200448 00000100:00100000:0.0:1786034711.967787:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786034711.967798:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:15037:x1872792636200448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786034711.968007:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:15037:x1872792636200448:12345-0@lo:501:mount.lustre.0 Request processed in 211us (648us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786034711.968015:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1786034711.968181:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636200448:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1786034711.968195:0:15037:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1786034711.968343:0:15037:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1786034711.968350:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1000/0x490975051af40bef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40bf6 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034711.968359:0:15037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff9645413f1000/0x490975051af40bef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40bf6 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034711.968380:0:15037:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9645747a5000 10000000:01000000:3.0:1786034711.968524:0:15037:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1786034711.968531:0:15037:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9645519a4d40 10000000:01000000:3.0:1786034711.968534:0:15037:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1786034711.968537:0:15037:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9645519a4d40 from 1 10000000:01000000:3.0:1786034711.968541:0:15037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1786034711.968571:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af40d07 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034711.968580:0:15037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af40d07 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034711.968589:0:15037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af40d07 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034711.968615:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636200576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786034711.968646:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034711.968666:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cecb40 going to sleep for 11 seconds 00000100:00100000:2.0:1786034711.968726:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636200576 00000100:00100000:2.0:1786034711.968731:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636200576 00000100:00100000:2.0:1786034711.968766:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1786034711.968774:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+12:15037:x1872792636200576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786034711.968785:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034711.968808:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964548aa7e00/0x490975051af40d0e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40d07 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034711.968869:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964548aa7e00/0x490975051af40d0e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40d07 expref: 13 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034711.968880:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964548aa7e00/0x490975051af40d0e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40d07 expref: 13 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034711.968890:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7e00, rc 0) 00000100:00100000:2.0:1786034711.968920:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+13:15037:x1872792636200576:12345-0@lo:101:mount.lustre.0 Request processed in 147us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034711.968926:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1786034711.969138:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636200576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786034711.969152:0:15037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af40d07 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d0e expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034711.969168:0:15037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af40d07 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40d0e expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034711.969186:0:15037:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1786034711.969201:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af40d07 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d0e expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034711.969209:0:15037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff9645413f0c00/0x490975051af40d07 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d0e expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034711.969216:0:15037:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1786034711.969220:0:15037:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786034711.969224:0:15037:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1786034711.969226:0:15037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1786034711.969240:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1400/0x490975051af40d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034711.969248:0:15037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff9645413f1400/0x490975051af40d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034711.969256:0:15037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff9645413f1400/0x490975051af40d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034711.969267:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636200704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786034711.969290:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034711.969317:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cecb40 going to sleep for 11 seconds 00000100:00100000:0.0:1786034711.969372:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636200704 00000100:00100000:0.0:1786034711.969376:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636200704 00000100:00100000:0.0:1786034711.969415:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1786034711.969422:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+13:15037:x1872792636200704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786034711.969429:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034711.969437:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df9600/0x490975051af40d1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40d15 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034711.969452:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df9600/0x490975051af40d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40d15 expref: 14 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034711.969471:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df9600/0x490975051af40d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40d15 expref: 14 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034711.969478:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9600, rc 0) 00000100:00100000:0.0:1786034711.969508:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+14:15037:x1872792636200704:12345-0@lo:101:mount.lustre.0 Request processed in 86us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034711.969514:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1786034711.969641:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636200704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786034711.969652:0:15037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff9645413f1400/0x490975051af40d15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d1c expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034711.969665:0:15037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff9645413f1400/0x490975051af40d15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40d1c expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786034711.971364:0:15037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1786034711.978698:0:15037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786034711.979583:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1786034711.979652:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1786034711.979691:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1786034711.979735:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1786034711.979773:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1786034711.979810:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1786034711.983746:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1786034711.983767:0:15037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1786034711.983958:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636200832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786034711.984046:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034711.984092:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454ad06e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786034711.984340:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636200832 00000100:00100000:0.0:1786034711.984349:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636200832 00000100:00100000:0.0:1786034711.984411:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786034711.984422:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+14:15037:x1872792636200832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786034711.984891:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+14:15037:x1872792636200832:12345-0@lo:501:mount.lustre.0 Request processed in 470us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034711.984901:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786034711.985623:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636200832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786034711.985672:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636200960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786034711.985722:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034711.985752:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454ad06e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786034711.989027:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636200960 00000100:00100000:1.0:1786034711.989051:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636200960 00000100:00100000:1.0:1786034711.989120:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786034711.989132:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+14:15037:x1872792636200960:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786034711.989589:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+14:15037:x1872792636200960:12345-0@lo:503:mount.lustre.0 Request processed in 458us (3865us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034711.989612:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1786034711.991013:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636200960:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1786034711.992691:0:15037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786034711.992799:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786034711.993299:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034711.993386:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454ad06e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786034712.006000:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636201088 00000100:00100000:1.0:1786034712.006017:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636201088 00000100:00100000:1.0:1786034712.006103:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786034712.006114:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+14:15037:x1872792636201088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786034712.006519:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+14:15037:x1872792636201088:12345-0@lo:502:mount.lustre.0 Request processed in 406us (13220us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034712.006529:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1786034712.007050:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1786034712.007382:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1786034712.007449:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1786034712.007485:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1786034712.007536:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1786034712.007575:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1786034712.007623:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1786034712.007685:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1786034712.007722:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1786034712.007757:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1786034712.007809:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1786034712.009220:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1786034712.009286:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1786034712.009348:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786034712.009442:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034712.009494:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454ad06e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786034712.009562:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636201216 00000100:00100000:0.0:1786034712.009572:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636201216 00000100:00100000:0.0:1786034712.009645:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1786034712.009655:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+14:15037:x1872792636201216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786034712.009919:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+14:15037:x1872792636201216:12345-0@lo:502:mount.lustre.0 Request processed in 264us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034712.009929:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1786034712.010170:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1786034712.010255:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1786034712.010266:0:15037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1786034712.014437:0:15051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1786034712.014452:0:15051:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1786034712.014460:0:15051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034712.014462:0:15051:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1786034712.014476:0:15051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786034712.014495:0:15051:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9645595e3380) 00000020:00000080:2.0:1786034712.014535:0:15051:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1786034712.014542:0:15051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1786034712.014650:0:15051:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9645747a5000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1786034712.014658:0:15051:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1786034712.014668:0:15051:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x490975051af40d2a 00010000:00010000:0.0:1786034712.029196:0:15051:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1786034712.031480:0:15051:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1786034712.039584:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1786034712.085618:0:15051:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1786034712.085637:0:15051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034712.085664:0:15051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034712.085667:0:15051:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1786034712.085671:0:15051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1786034712.085674:0:15051:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1786034712.085676:0:15051:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786034712.085677:0:15051:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786034712.085679:0:15051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1786034712.085682:0:15051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034712.085684:0:15051:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1786034712.085687:0:15051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786034712.085690:0:15051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034712.085691:0:15051:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786034712.085694:0:15051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786034712.085696:0:15051:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1786034712.085698:0:15051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034712.085701:0:15051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034712.085702:0:15051:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1786034712.085705:0:15051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786034712.085707:0:15051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034712.085709:0:15051:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1786034712.085712:0:15051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1786034712.085807:0:15051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786034712.085811:0:15051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786034712.085813:0:15051:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1786034712.086289:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1786034712.086727:0:15037:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1786034712.086757:0:15037:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1786034712.086786:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1400/0x490975051af40d15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d1c expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.086842:0:15037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff9645413f1400/0x490975051af40d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d1c expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034712.086852:0:15037:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9645747a5000 from 1 10000000:01000000:1.0:1786034712.086856:0:15037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786034712.086900:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.086908:0:15037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.086921:0:15037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034712.086949:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786034712.087029:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034712.087083:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645595b6240 going to sleep for 11 seconds 00000100:00100000:0.0:1786034712.088894:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636201344 00000100:00100000:0.0:1786034712.088905:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636201344 00000100:00100000:0.0:1786034712.088959:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1786034712.088969:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+14:15037:x1872792636201344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786034712.088987:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034712.089004:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df9800/0x490975051af40d38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40d31 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034712.089035:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df9800/0x490975051af40d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40d31 expref: 15 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034712.089067:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df9800/0x490975051af40d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40d31 expref: 15 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034712.089076:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9800, rc 0) 00000100:00100000:0.0:1786034712.089144:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+15:15037:x1872792636201344:12345-0@lo:101:mount.lustre.0 Request processed in 177us (2115us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034712.089152:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1786034712.089355:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786034712.089374:0:15037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d38 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034712.089384:0:15037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40d38 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786034712.090011:0:15037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1786034712.091125:0:15037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786034712.094762:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1786034712.094858:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1786034712.094926:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1786034712.094934:0:15037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1786034712.095063:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786034712.095138:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034712.095207:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cec480 going to sleep for 11 seconds 00000100:00100000:1.0:1786034712.099013:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636201472 00000100:00100000:1.0:1786034712.099029:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636201472 00000100:00100000:1.0:1786034712.099095:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1786034712.099107:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+15:15037:x1872792636201472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786034712.099475:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+15:15037:x1872792636201472:12345-0@lo:501:mount.lustre.0 Request processed in 369us (4335us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034712.099484:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1786034712.099899:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786034712.099960:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786034712.100015:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034712.100053:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cec480 going to sleep for 11 seconds 00000100:00100000:0.0:1786034712.100302:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636201600 00000100:00100000:0.0:1786034712.100307:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636201600 00000100:00100000:0.0:1786034712.100337:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786034712.100344:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+15:15037:x1872792636201600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786034712.100532:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+15:15037:x1872792636201600:12345-0@lo:503:mount.lustre.0 Request processed in 188us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034712.100540:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1786034712.100916:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201600:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1786034712.103018:0:15037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786034712.103112:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786034712.110050:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034712.110114:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454ad06d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786034712.110234:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636201728 00000100:00100000:3.0:1786034712.110246:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636201728 00000100:00100000:3.0:1786034712.110325:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786034712.110336:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+15:15037:x1872792636201728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786034712.110733:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+15:15037:x1872792636201728:12345-0@lo:502:mount.lustre.0 Request processed in 398us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034712.110742:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786034712.110961:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786034712.111311:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1786034712.111373:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1786034712.111457:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1786034712.111497:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1786034712.111533:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1786034712.111581:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1786034712.111744:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1786034712.111780:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1786034712.119479:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786034712.120294:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034712.120551:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cec300 going to sleep for 11 seconds 00000100:00100000:2.0:1786034712.123395:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636201856 00000100:00100000:2.0:1786034712.123412:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636201856 00000100:00100000:2.0:1786034712.123474:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1786034712.123487:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+15:15037:x1872792636201856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786034712.123944:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+15:15037:x1872792636201856:12345-0@lo:502:mount.lustre.0 Request processed in 459us (3649us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034712.123953:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786034712.124557:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201856:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786034712.124767:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1786034712.124786:0:15037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1786034712.126166:0:15055:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786034712.126178:0:15055:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034712.126181:0:15055:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1786034712.126188:0:15055:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9645747a5000 00000020:00000080:1.0:1786034712.126191:0:15055:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786034712.126198:0:15055:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786034712.126201:0:15055:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034712.126202:0:15055:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1786034712.126205:0:15055:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786034712.126207:0:15055:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034712.126209:0:15055:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1786034712.126211:0:15055:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9645747a5000 00000020:00000080:1.0:1786034712.126213:0:15055:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786034712.126334:0:15055:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786034712.126338:0:15055:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034712.126339:0:15055:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1786034712.126342:0:15055:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786034712.126345:0:15055:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034712.126346:0:15055:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1786034712.126349:0:15055:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9645747a5000 00000020:00000080:1.0:1786034712.126351:0:15055:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786034712.140498:0:15055:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786034712.140516:0:15055:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034712.140519:0:15055:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1786034712.140524:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1786034712.144804:0:15037:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1786034712.144882:0:15037:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786034712.144904:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d38 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034712.144918:0:15037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d38 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034712.144983:0:15037:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1786034712.144986:0:15037:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9645747a5000 10000000:01000000:3.0:1786034712.144989:0:15037:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9645747a5000 10000000:01000000:3.0:1786034712.144994:0:15037:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786034712.145010:0:15037:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9645747a5000 from 1 10000000:01000000:3.0:1786034712.145013:0:15037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786034712.145073:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af40d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034712.145083:0:15037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af40d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034712.145098:0:15037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af40d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034712.145127:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786034712.145221:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034712.145266:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cecc00 going to sleep for 11 seconds 00000100:00100000:2.0:1786034712.147718:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636201984 00000100:00100000:2.0:1786034712.147732:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636201984 00000100:00100000:2.0:1786034712.147800:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786034712.147812:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+15:15037:x1872792636201984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786034712.147850:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034712.147871:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964548aa6600/0x490975051af40d46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40d3f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034712.147903:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964548aa6600/0x490975051af40d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40d3f expref: 16 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034712.147923:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964548aa6600/0x490975051af40d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40d3f expref: 16 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034712.147934:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6600, rc 0) 00000100:00100000:2.0:1786034712.148014:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15037:x1872792636201984:12345-0@lo:101:mount.lustre.0 Request processed in 203us (2793us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034712.148021:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1786034712.148170:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636201984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786034712.148192:0:15037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af40d3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d46 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034712.148211:0:15037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af40d3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40d46 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786034712.149045:0:15037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1786034712.149376:0:15037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786034712.149622:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1786034712.149812:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1786034712.149922:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1786034712.149961:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1786034712.149991:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1786034712.150047:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1786034712.150251:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1786034712.150301:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1786034712.150342:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1786034712.150369:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1786034712.150394:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1786034712.150429:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1786034712.150455:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1786034712.150480:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1786034712.150521:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1786034712.150557:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1786034712.150590:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1786034712.150759:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1786034712.150793:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1786034712.150898:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1786034712.150943:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1786034712.150971:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1786034712.150999:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1786034712.151170:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1786034712.151200:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1786034712.151732:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1786034712.151781:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1786034712.151939:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1786034712.152895:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1786034712.152911:0:15037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1786034712.153711:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636202112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786034712.153787:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034712.154153:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cecc00 going to sleep for 11 seconds 00000100:00100000:1.0:1786034712.156839:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636202112 00000100:00100000:1.0:1786034712.156854:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636202112 00000100:00100000:1.0:1786034712.156912:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1786034712.156923:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15037:x1872792636202112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786034712.157291:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15037:x1872792636202112:12345-0@lo:501:mount.lustre.0 Request processed in 369us (3502us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034712.157299:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1786034712.157378:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636202112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786034712.157439:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636202240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786034712.157489:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034712.157511:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c6e9600 going to sleep for 11 seconds 00000100:00100000:1.0:1786034712.157524:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636202240 00000100:00100000:1.0:1786034712.157527:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636202240 00000100:00100000:1.0:1786034712.157547:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1786034712.157553:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15037:x1872792636202240:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786034712.157719:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15037:x1872792636202240:12345-0@lo:503:mount.lustre.0 Request processed in 164us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034712.157726:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1786034712.157763:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636202240:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1786034712.158586:0:15037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786034712.158691:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636202368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786034712.158732:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034712.158752:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c6e9600 going to sleep for 11 seconds 00000100:00100000:1.0:1786034712.158771:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636202368 00000100:00100000:1.0:1786034712.158775:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636202368 00000100:00100000:1.0:1786034712.158802:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786034712.158810:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15037:x1872792636202368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786034712.159077:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15037:x1872792636202368:12345-0@lo:502:mount.lustre.0 Request processed in 267us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034712.159086:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786034712.159146:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636202368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786034712.159464:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1786034712.159529:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1786034712.159563:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1786034712.162029:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1786034712.162133:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1786034712.162199:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1786034712.162247:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1786034712.162283:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1786034712.162340:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1786034712.162394:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1786034712.162431:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1786034712.162483:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1786034712.162522:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1786034712.162558:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1786034712.164958:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1786034712.165057:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1786034712.165096:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1786034712.165150:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1786034712.165187:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1786034712.165224:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1786034712.165277:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1786034712.165315:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1786034712.165349:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1786034712.165399:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1786034712.165437:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1786034712.165473:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1786034712.165522:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1786034712.165559:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1786034712.165608:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1786034712.165662:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1786034712.165698:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1786034712.165733:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1786034712.165768:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1786034712.165818:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1786034712.166176:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1786034712.166229:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1786034712.166268:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1786034712.166302:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1786034712.166356:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1786034712.166394:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1786034712.166458:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636202496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786034712.166556:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034712.166744:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c6e9600 going to sleep for 11 seconds 00000100:00100000:2.0:1786034712.170352:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636202496 00000100:00100000:2.0:1786034712.170367:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636202496 00000100:00100000:3.0:1786034712.170533:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786034712.170544:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15037:x1872792636202496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786034712.171048:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15037:x1872792636202496:12345-0@lo:502:mount.lustre.0 Request processed in 504us (4491us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034712.171069:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786034712.171147:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636202496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786034712.171285:0:15037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1786034712.171301:0:15037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1786034712.192030:0:15060:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1786034712.192053:0:15060:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9645595e19c0) 00000020:00000080:2.0:1786034712.192082:0:15060:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1786034712.209920:0:15060:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9645747a5000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1786034712.209931:0:15060:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9645747a5000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1786034712.209934:0:15060:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9645747a5000 3 00010000:00080000:3.0:1786034712.209980:0:15060:0:(ldlm_lib.c:102:import_set_conn()) imp ffff964558cfa800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.156@tcp at head 00010000:00010000:3.0:1786034712.218855:0:15060:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1786034712.218977:0:15060:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1786034712.219046:0:15060:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786034712.219062:0:15060:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x490975051af40d54 00000100:00080000:3.0:1786034712.219076:0:15060:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786034712.219083:0:15060:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff964558cfa800 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:3.0:1786034712.219132:0:15060:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96457514ce00 x1872792636202624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786034712.219166:0:15060:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1786034712.219362:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786034712.219368:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1786034712.219370:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786034712.219373:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1786034712.219434:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636202752:0@lo:400:kworker.0 00000100:00100000:2.0:1786034712.219513:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034712.219571:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636202752 00000100:00100000:2.0:1786034712.219579:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636202752 00000100:00100000:2.0:1786034712.219635:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786034712.219645:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636202752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034712.219696:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636202752:12345-0@lo:400:kworker.0 Request processed in 53us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034712.219704:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1786034712.219753:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff964574df8a80 x1872792636202752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034712.219767:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636202752:0@lo:400:kworker.0 00000100:00100000:0.0:1786034712.229180:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1872792636202624:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786034712.229279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034712.229362:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636202624 00000100:00100000:0.0:1786034712.229370:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636202624 00000100:00100000:0.0:1786034712.229407:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786034712.229415:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1872792636202624:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1786034712.229448:0:14357:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:0.0:1786034712.233923:0:14357:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x490975051af40d5b 00000004:00100000:0.0:1786034712.233957:0:14357:0:(mdt_handler.c:7332:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786034712.234018:0:14357:0:(import.c:65:import_set_state_nolock()) ffff9644458f0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786034712.234137:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872792636202624:12345-0@lo:38:llog_process_th.0 Request processed in 4719us (4855us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034712.234165:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1786034712.235265:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96457514ce00 x1872792636202624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786034722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034712.235280:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786034712.235289:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1786034712.235298:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1786034712.235304:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1786034712.235306:0:3306:0:(import.c:65:import_set_state_nolock()) ffff964558cfa800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1786034712.235314:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1872792636202624:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1786034712.251795:0:15060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1786034712.252667:0:15037:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1786034712.252701:0:15037:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786034712.252728:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af40d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d46 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.252742:0:15037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff9645413f1200/0x490975051af40d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d46 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786034712.252818:0:15037:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786034712.252841:0:15037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786034712.252843:0:15037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786034712.252845:0:15037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786034712.252847:0:15037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786034712.252848:0:15037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786034712.252851:0:15037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786034712.252853:0:15037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786034712.252855:0:15037:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786034712.252860:0:15037:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1786034712.252862:0:15037:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786034712.252864:0:15037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786034712.252865:0:15037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786034712.252867:0:15037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786034712.252868:0:15037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786034712.252869:0:15037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786034712.252870:0:15037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786034712.252878:0:15037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786034712.252879:0:15037:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786034712.252909:0:15037:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1786034712.252931:0:15037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636202880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1786034712.253007:0:15037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034712.253047:0:15037:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c6e9840 going to sleep for 11 seconds 00000100:00100000:0.0:1786034712.253108:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636202880 00000100:00100000:0.0:1786034712.253118:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636202880 00000100:00100000:0.0:1786034712.253177:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1786034712.253187:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15037:x1872792636202880:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1786034712.253229:0:14348:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1786034712.253247:0:14348:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1786034712.386350:0:14348:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1786034712.386370:0:14348:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1786034712.386424:0:14372:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1786034712.386431:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1786034712.386459:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034712.386482:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9645413f0e00/0x490975051af40ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40cc8 expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034712.386502:0:14372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034712.386693:0:14372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9645413f0e00/0x490975051af40ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af40cc8 expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034712.386709:0:14372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9645413f0e00/0x490975051af40ccf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af40cc8 expref: 16 pid: 14350 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034712.386727:0:14372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1872792636203008:0@lo:104: 00000100:00100000:3.0:1786034712.386954:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034712.387016:0:14372:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c751240 going to sleep for 11 seconds 00000100:00100000:0.0:1786034712.388674:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636203008 00000100:00100000:0.0:1786034712.388685:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636203008 00000100:00100000:0.0:1786034712.388746:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786034712.388756:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+3:14372:x1872792636203008:12345-0@lo:104: 00010000:00010000:0.0:1786034712.388772:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af40ccf expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034712.388896:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786034712.388903:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+3:14372:x1872792636203008:12345-0@lo:104: Request processed in 149us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034712.388912:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786034712.389151:0:14372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1872792636203008:0@lo:104: 00010000:00010000:2.0:1786034712.389176:0:14372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.392101:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034712.392114:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af40ccf expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.392126:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1c00 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:1.0:1786034712.392131:0:14344:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af40ccf expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.392142:0:14344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af40ccf expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786034712.392151:0:14344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af40ccf expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034712.392158:0:14344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1786034712.392216:0:14344:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40ccf expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.392222:0:14344:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786034712.392258:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40ccf expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.392265:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff9645413f1c00/0x490975051af40cc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40ccf expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.392288:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034712.392304:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034712.392306:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034712.392315:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786034712.392336:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3309:1872792636203136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034712.392402:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034712.392473:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636203136 00000100:00100000:1.0:1786034712.392480:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636203136 00010000:00010000:1.0:1786034712.392516:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9645413f0e00/0x490975051af40ccf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af40cc8 expref: 17 pid: 14350 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034712.396209:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786034712.396231:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:3309:x1872792636203136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786034712.396250:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034712.396258:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9645413f0e00/0x490975051af40ccf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af40cc8 expref: 17 pid: 14350 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.396273:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9645413f0e00/0x490975051af40ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af40cc8 expref: 17 pid: 14350 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.396294:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f0e00/0x490975051af40ccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af40cc8 expref: 17 pid: 14350 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.396314:0:14342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.396324:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786034712.396342:0:14342:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009911999s 00010000:00010000:1.0:1786034712.396347:0:14342:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.396374:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.396382:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.396389:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.396397:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1e00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034712.396402:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.396410:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.396431:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034712.396444:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786034712.398661:0:14372:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034712.398677:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034712.398685:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9645413f1e00/0x490975051af40d62 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034712.399941:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:3309:x1872792636203136:12345-0@lo:103:ldlm_bl.0 Request processed in 3717us (7533us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034712.399953:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786034712.407118:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+15:15037:x1872792636202880:12345-0@lo:253:mount.lustre.0 Request processed in 153921us (154098us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034712.407139:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786034712.407330:0:15037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15037:1872792636202880:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1786034712.407348:0:15037:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1786034712.407352:0:15037:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786034712.407354:0:15037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786034712.407355:0:15037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786034712.407356:0:15037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786034712.407357:0:15037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786034712.407383:0:15037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786034712.407384:0:15037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786034712.407386:0:15037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786034712.407388:0:15037:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786034712.407407:0:15037:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1786034712.407623:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3309:1872792636203136:0@lo:103:ldlm_bl.0 00080000:10000000:1.0:1786034712.432339:0:15037:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1786034712.433982:0:15037:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1786034712.436759:0:15037:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1786034712.437446:0:15037:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1786034712.440141:0:15037:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1786034712.442266:0:15037:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1786034712.447914:0:15037:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1786034712.652250:0:15037:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1786034712.652259:0:15037:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1786034712.652286:0:15037:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1786034712.652339:0:15037:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1786034712.652356:0:15037:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1786034712.652392:0:15037:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1786034712.693979:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786034713.715180:0:14353:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1786034713.715191:0:14353:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9645751e6000 from 7 10000000:01000000:3.0:1786034713.715197:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786034713.715259:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034713.715273:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034713.715287:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034713.715338:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636203264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786034713.715440:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034713.715506:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c751300 going to sleep for 11 seconds 00000100:00100000:1.0:1786034713.715640:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636203264 00000100:00100000:1.0:1786034713.715650:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636203264 00000100:00100000:1.0:1786034713.715722:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1786034713.715734:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+15:14353:x1872792636203264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786034713.715750:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034713.715766:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964574d00a00/0x490975051af40d70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40d69 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034713.715793:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964574d00a00/0x490975051af40d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40d69 expref: 16 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034713.715805:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964574d00a00/0x490975051af40d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40d69 expref: 16 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034713.715816:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964574d00a00, rc 0) 00000100:00100000:1.0:1786034713.715891:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:14353:x1872792636203264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034713.715899:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1786034713.715952:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636203264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786034713.715974:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d70 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034713.715984:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40d70 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034713.716036:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636203392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1786034713.716079:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034713.716101:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454f664a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786034713.716114:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636203392 00000100:00100000:1.0:1786034713.716118:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636203392 00000100:00100000:1.0:1786034713.716140:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1786034713.716146:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:14353:x1872792636203392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1786034713.716163:0:14348:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1786034713.716181:0:14348:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1786034713.716185:0:14348:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1786034713.716265:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:14353:x1872792636203392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034713.716272:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1786034713.716302:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636203392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1786034713.716363:0:14353:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786034713.716384:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d70 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034713.716393:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40d70 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034713.719116:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034714.741155:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034715.760029:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786034716.272548:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1786034716.796882:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786034717.234059:0:10438:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786034717.234067:0:10438:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1786034717.234078:0:10438:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786034717.234082:0:10438:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1786034717.234153:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636203776:0@lo:400:kworker.0 00000100:00100000:3.0:1786034717.234247:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034717.234462:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636203648:0@lo:400:kworker.0 00000100:00100000:3.0:1786034717.234490:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034717.234522:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786034717.234528:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3308:1872792636203520:0@lo:400:kworker.0 00000100:00100000:3.0:1786034717.234557:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034717.234615:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636203776 00000100:00100000:3.0:1786034717.234623:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636203776 00000100:00100000:3.0:1786034717.234683:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636203648 00000100:00100000:3.0:1786034717.234686:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636203648 00000100:00100000:3.0:1786034717.234707:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786034717.234716:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636203776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034717.234775:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636203776:12345-0@lo:400:kworker.0 Request processed in 60us (528us total) trans 0 rc 0/0 00000100:00080000:1.0:1786034717.235009:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034717.235103:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786034717.235143:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786034717.235150:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636203648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034717.235195:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872792636203648:12345-0@lo:400:kworker.0 Request processed in 45us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034717.235202:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786034717.235222:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636203520 00000100:00100000:3.0:1786034717.235226:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636203520 00010000:00080000:1.0:1786034717.235446:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96457514dc00 x1872792636203648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034717.235463:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872792636203648:0@lo:400:kworker.0 00000100:00100000:3.0:1786034717.235589:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1786034717.235597:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:3308:x1872792636203520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034717.235645:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:3308:x1872792636203520:12345-0@lo:400:kworker.0 Request processed in 49us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034717.235652:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1786034717.235698:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96457514fb80 x1872792636203776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786034717.235708:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636203776:0@lo:400:kworker.0 00000100:00100000:1.0:1786034717.237353:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3308:1872792636203520:0@lo:400:kworker.0 00010000:00010000:3.0:1786034717.809038:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034718.844875:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034719.407953:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786034704/real 1786034704] req@ffff964574dfaa00 x1872792636199552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786034719 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034719.408003:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff964574dfaa00 x1872792636199552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786034719 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034719.408017:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786034704/real 1786034704] req@ffff964574df9180 x1872792636199424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786034719 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034719.408029:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff964574df9180 x1872792636199424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786034719 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786034719.408176:0:3306:0:(import.c:65:import_set_state_nolock()) ffff964551259000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786034719.408212:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1786034719.408217:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636199552:0@lo:8:kworker.0 00000100:00080000:1.0:1786034719.408224:0:3306:0:(import.c:65:import_set_state_nolock()) ffff964558c22000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786034719.408229:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1786034719.408232:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636199424:0@lo:8:kworker.0 00000100:00080000:2.0:1786034719.408410:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786034719.408415:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1786034719.408418:0:8:0:(import.c:65:import_set_state_nolock()) ffff964558c22000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786034719.408424:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 541 00000100:00080000:2.0:1786034719.408429:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786034719.408437:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff964558c22000 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:2.0:1786034719.408461:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff964574dfbb80 x1872792636204032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786034719.408501:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786034719.408504:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1786034719.408506:0:8:0:(import.c:65:import_set_state_nolock()) ffff964551259000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786034719.408509:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 541 00000100:00080000:2.0:1786034719.408512:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786034719.408516:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff964551259000 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:2.0:1786034719.408529:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff964574df8000 x1872792636204160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786034719.408599:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636204288:0@lo:400:kworker.0 00000100:00100000:2.0:1786034719.408679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034719.408751:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786034719.408757:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636204416:0@lo:400:kworker.0 00000100:00100000:0.0:1786034719.409027:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3310:1872792636203904:0@lo:400:kworker.0 00000100:00100000:0.0:1786034719.409081:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034719.409128:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636203904 00000100:00100000:0.0:1786034719.409136:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636203904 00000100:00100000:0.0:1786034719.409189:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786034719.409200:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:3310:x1872792636203904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034719.409253:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:3310:x1872792636203904:12345-0@lo:400:kworker.0 Request processed in 55us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034719.409261:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786034719.409312:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3310:1872792636203904:0@lo:400:kworker.0 00000100:00100000:0.0:1786034719.409363:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636204288 00000100:00100000:0.0:1786034719.409367:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636204288 00000100:00100000:0.0:1786034719.409397:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786034719.409403:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636204288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034719.409438:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636204288:12345-0@lo:400:kworker.0 Request processed in 35us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034719.409445:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786034719.409467:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636204032:0@lo:8:kworker.0 00000100:00100000:0.0:1786034719.409495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034719.409514:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636204160:0@lo:8:kworker.0 00000100:00100000:0.0:1786034719.409556:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034719.409594:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636204032 00000100:00100000:0.0:1786034719.409598:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636204032 00000100:00100000:0.0:1786034719.409617:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636204160 00000100:00100000:0.0:1786034719.409620:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636204160 00000100:00100000:0.0:1786034719.409630:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786034719.409634:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1872792636204032:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1786034719.409662:0:15039:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:0.0:1786034719.409701:0:15039:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x490975051af40d77 00002000:00100000:0.0:1786034719.409719:0:15039:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff964549e90800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113834 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1786034719.409736:0:15039:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1786034719.409739:0:15039:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1786034719.410598:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1786034719.410631:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964574df9180 x1872792636204288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034719.410644:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636204288:0@lo:400:kworker.0 00000100:00100000:2.0:1786034719.410671:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636204416 00000100:00100000:2.0:1786034719.410674:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636204416 00002000:00080000:1.0:1786034719.422466:0:15039:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1786034719.422517:0:15039:0:(import.c:65:import_set_state_nolock()) ffff964445efc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786034719.422700:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1872792636204032:12345-0@lo:8:kworker.0 Request processed in 13062us (13201us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034719.422718:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786034719.422770:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786034719.422778:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1872792636204160:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1786034719.422798:0:15039:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786034719.422841:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1872792636204160:12345-0@lo:8:kworker.0 Request processed in 62us (13284us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786034719.422847:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1786034719.428086:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034719.428211:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786034719.428235:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636204416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034719.428352:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636204416:12345-0@lo:400:kworker.0 Request processed in 130us (17755us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034719.428370:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1786034719.428899:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964574dfaa00 x1872792636204416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034719.428920:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636204416:0@lo:400:kworker.0 00010000:00080000:0.0:1786034719.434191:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964574dfbb80 x1872792636204032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786034739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034719.434209:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786034719.434221:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1786034719.434233:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1786034719.434240:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1786034719.434244:0:3306:0:(import.c:65:import_set_state_nolock()) ffff964558c22000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1786034719.434336:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1786034719.434345:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636204032:0@lo:8:kworker.0 00000100:00080000:0.0:1786034719.434371:0:3306:0:(import.c:65:import_set_state_nolock()) ffff964551259000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786034719.434376:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786034719.434379:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636204160:0@lo:8:kworker.0 00000004:00080000:1.0:1786034719.436377:0:14379:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1786034719.436408:0:14379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14379:1872792636204672:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1786034719.436494:0:14379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034719.436532:0:14379:0:(client.c:2702:ptlrpc_set_wait()) set ffff964551224600 going to sleep for 11 seconds 00000100:00100000:1.0:1786034719.436577:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636204672 00000100:00100000:1.0:1786034719.436585:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636204672 00000100:00100000:1.0:1786034719.436649:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786034719.436659:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14379:x1872792636204672:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1786034719.444229:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636204544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786034719.444337:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786034719.444455:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786034719.444514:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636204544 00000100:00100000:0.0:1786034719.444523:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636204544 00000100:00100000:0.0:1786034719.444590:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786034719.444600:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1872792636204544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034719.444642:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034719.444690:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1872792636204544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034719.444697:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1786034719.444752:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9645412a9c00 x1872792636204544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034719.445427:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636204544:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1786034719.454063:0:14378:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1786034719.455397:0:14378:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 555663572232ns, next at 0ns, rc = 0 00002000:00080000:1.0:1786034719.456642:0:15040:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1786034719.456652:0:15040:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1786034719.456660:0:15040:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1786034719.499930:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.499945:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40d7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.499966:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.499971:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.499978:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40d7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.499998:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40d7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500011:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40d7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500020:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40d7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500046:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034719.500065:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034719.500071:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40d7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500080:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01800 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.500085:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40d7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500108:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40d7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500128:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40d7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500137:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40d7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500158:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.500160:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.500162:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.500624:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.500630:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40d85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500639:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.500642:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.500647:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500656:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500664:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500676:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40d85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500693:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034719.500701:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034719.500706:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40d85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500712:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.500716:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40d85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500725:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40d85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500735:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40d85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500741:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40d85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.500755:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.500756:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.500758:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.501190:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.501203:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039593584/0x490975051af40d8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501213:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.501216:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.501220:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039593584/0x490975051af40d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501230:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039593584/0x490975051af40d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501237:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039593584/0x490975051af40d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501245:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039593584/0x490975051af40d8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501258:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034719.501267:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034719.501271:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039593584/0x490975051af40d8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501279:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00200 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.501282:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039593584/0x490975051af40d8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501290:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039593584/0x490975051af40d8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501308:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039593584/0x490975051af40d8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501316:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039593584/0x490975051af40d8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501330:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.501332:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.501334:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.501724:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.501730:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a743b4fc/0x490975051af40d93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501738:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.501741:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.501746:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a743b4fc/0x490975051af40d93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501755:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a743b4fc/0x490975051af40d93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501763:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a743b4fc/0x490975051af40d93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501771:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a743b4fc/0x490975051af40d93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501796:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034719.501803:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034719.501807:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a743b4fc/0x490975051af40d93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501813:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01600 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.501817:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a743b4fc/0x490975051af40d93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501848:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a743b4fc/0x490975051af40d93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501861:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a743b4fc/0x490975051af40d93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501869:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a743b4fc/0x490975051af40d93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.501883:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.501885:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.501886:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.502239:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.502245:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af40d9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.502253:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.502262:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.502267:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af40d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.502277:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af40d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.502286:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af40d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.502294:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af40d9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.502308:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034719.502316:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034719.502320:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af40d9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.502327:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00c00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.502331:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af40d9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.502339:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af40d9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.502349:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af40d9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.502366:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003040cd32/0x490975051af40d9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.502379:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.502381:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.502383:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.522254:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.522271:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000317687a3/0x490975051af40da1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.522291:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.522297:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.522304:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000317687a3/0x490975051af40da1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.522321:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000317687a3/0x490975051af40da1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.522333:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000317687a3/0x490975051af40da1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.522341:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000317687a3/0x490975051af40da1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.522359:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786034719.522858:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.522872:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fa595ec/0x490975051af40da8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.522881:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.522884:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.522888:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa595ec/0x490975051af40da8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.522898:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa595ec/0x490975051af40da8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.522906:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fa595ec/0x490975051af40da8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.522912:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fa595ec/0x490975051af40da8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.522927:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786034719.522941:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786034719.522948:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000317687a3/0x490975051af40da1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.522957:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01e00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.522962:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000317687a3/0x490975051af40da1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.522972:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000317687a3/0x490975051af40da1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.522998:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000317687a3/0x490975051af40da1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523006:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000317687a3/0x490975051af40da1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523027:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034719.523031:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fa595ec/0x490975051af40da8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523037:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.523041:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa595ec/0x490975051af40da8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523048:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fa595ec/0x490975051af40da8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523057:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fa595ec/0x490975051af40da8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523065:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa595ec/0x490975051af40da8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523081:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.523083:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.523090:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.523491:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.523497:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d85b24be/0x490975051af40daf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523507:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.523510:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.523514:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d85b24be/0x490975051af40daf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523523:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d85b24be/0x490975051af40daf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523532:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d85b24be/0x490975051af40daf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523540:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d85b24be/0x490975051af40daf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523569:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034719.523577:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034719.523581:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d85b24be/0x490975051af40daf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523588:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00600 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.523592:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d85b24be/0x490975051af40daf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523613:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d85b24be/0x490975051af40daf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523625:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d85b24be/0x490975051af40daf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523632:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d85b24be/0x490975051af40daf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.523647:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.523649:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.523650:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.524066:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.524072:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc0bf124/0x490975051af40db6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.524080:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.524083:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.524088:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0bf124/0x490975051af40db6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.524098:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc0bf124/0x490975051af40db6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.524107:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc0bf124/0x490975051af40db6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.524120:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0bf124/0x490975051af40db6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.524133:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034719.524141:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034719.524144:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc0bf124/0x490975051af40db6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.524151:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01a00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.524154:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc0bf124/0x490975051af40db6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.524162:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc0bf124/0x490975051af40db6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.524174:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc0bf124/0x490975051af40db6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.524182:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc0bf124/0x490975051af40db6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.524196:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.524197:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.524199:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034719.524804:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.534185:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.534212:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40dbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.534232:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.534238:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.534245:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40dbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.534261:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40dbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.534273:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40dbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.534281:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40dbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.534574:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786034719.535280:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.535287:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40dc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.535298:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.535302:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.535306:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40dc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.535317:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40dc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.535332:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40dc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.535340:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40dc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.550165:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786034719.550185:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40dbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.550202:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034719.550207:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40dbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.550220:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40dbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.550249:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40dbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.550266:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feec8cfd/0x490975051af40dbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.550300:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034719.550305:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40dc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.550312:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01800 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034719.550315:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40dc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.550324:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40dc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.550335:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40dc4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.550343:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034719.550345:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034719.550347:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.553187:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786034719.553204:0:15040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3b9ec60/0x490975051af40dc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.553261:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.554072:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.554081:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b2c46e/0x490975051af40dcb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554098:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.554104:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.554111:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b2c46e/0x490975051af40dcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554126:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b2c46e/0x490975051af40dcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554138:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b2c46e/0x490975051af40dcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554158:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b2c46e/0x490975051af40dcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554177:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034719.554187:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034719.554193:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b2c46e/0x490975051af40dcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554202:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00000 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.554207:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b2c46e/0x490975051af40dcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554216:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b2c46e/0x490975051af40dcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554234:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b2c46e/0x490975051af40dcb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554242:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b2c46e/0x490975051af40dcb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554257:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.554259:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.554261:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.554654:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.554666:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ec1599a/0x490975051af40dd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554674:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.554678:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.554682:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ec1599a/0x490975051af40dd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554691:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ec1599a/0x490975051af40dd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554699:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ec1599a/0x490975051af40dd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554706:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ec1599a/0x490975051af40dd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554717:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034719.554725:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034719.554728:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ec1599a/0x490975051af40dd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554736:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a200 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.554739:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ec1599a/0x490975051af40dd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554747:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ec1599a/0x490975051af40dd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554764:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ec1599a/0x490975051af40dd2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554772:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ec1599a/0x490975051af40dd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.554785:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.554787:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.554790:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.555208:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.555214:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c81bfee1/0x490975051af40dd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555223:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.555226:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.555230:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c81bfee1/0x490975051af40dd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555239:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c81bfee1/0x490975051af40dd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555247:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c81bfee1/0x490975051af40dd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555254:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c81bfee1/0x490975051af40dd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555276:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034719.555285:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034719.555289:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c81bfee1/0x490975051af40dd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555296:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724b400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.555299:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c81bfee1/0x490975051af40dd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555307:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c81bfee1/0x490975051af40dd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555318:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c81bfee1/0x490975051af40dd9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555325:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c81bfee1/0x490975051af40dd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555337:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.555338:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.555339:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.555724:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.555730:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084acedad/0x490975051af40de0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555738:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.555747:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.555752:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084acedad/0x490975051af40de0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555762:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084acedad/0x490975051af40de0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555771:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084acedad/0x490975051af40de0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555779:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084acedad/0x490975051af40de0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555792:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034719.555800:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034719.555804:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084acedad/0x490975051af40de0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555812:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a600 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.555815:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084acedad/0x490975051af40de0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555842:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084acedad/0x490975051af40de0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555853:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084acedad/0x490975051af40de0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555871:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084acedad/0x490975051af40de0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.555885:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.555887:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.555889:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.556290:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.556295:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b27bf09/0x490975051af40de7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.556303:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.556306:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.556311:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b27bf09/0x490975051af40de7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.556320:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b27bf09/0x490975051af40de7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.556328:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b27bf09/0x490975051af40de7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.556335:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b27bf09/0x490975051af40de7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.556348:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034719.556355:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034719.556365:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b27bf09/0x490975051af40de7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.556372:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724aa00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.556375:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b27bf09/0x490975051af40de7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.556383:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b27bf09/0x490975051af40de7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.556393:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b27bf09/0x490975051af40de7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.556400:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b27bf09/0x490975051af40de7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.556412:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.556413:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.556415:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.568487:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.568503:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b0fdd5/0x490975051af40dee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.568524:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.568529:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.568537:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092b0fdd5/0x490975051af40dee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.568582:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092b0fdd5/0x490975051af40dee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.568595:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b0fdd5/0x490975051af40dee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.568604:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092b0fdd5/0x490975051af40dee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.568627:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034719.568643:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034719.568650:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092b0fdd5/0x490975051af40dee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.568659:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724b600 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.568664:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b0fdd5/0x490975051af40dee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.568674:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b0fdd5/0x490975051af40dee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.568694:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092b0fdd5/0x490975051af40dee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.568702:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092b0fdd5/0x490975051af40dee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.568729:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.568730:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.568733:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034719.569365:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.569371:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fee288c8/0x490975051af40df5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.569380:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.569384:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.569388:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fee288c8/0x490975051af40df5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.569398:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fee288c8/0x490975051af40df5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.569406:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fee288c8/0x490975051af40df5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.569414:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fee288c8/0x490975051af40df5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.570865:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786034719.571421:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034719.571429:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b4233c5/0x490975051af40dfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.571455:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1786034719.571459:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034719.571465:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b4233c5/0x490975051af40dfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.571477:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b4233c5/0x490975051af40dfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.571487:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b4233c5/0x490975051af40dfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.571495:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b4233c5/0x490975051af40dfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786034719.576099:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1786034719.586743:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786034719.586774:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fee288c8/0x490975051af40df5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.586792:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724b800 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034719.586836:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fee288c8/0x490975051af40df5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.586850:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fee288c8/0x490975051af40df5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.586877:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fee288c8/0x490975051af40df5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.586886:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fee288c8/0x490975051af40df5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.587220:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034719.587228:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b4233c5/0x490975051af40dfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.587237:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724ae00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:3.0:1786034719.587241:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b4233c5/0x490975051af40dfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.587251:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b4233c5/0x490975051af40dfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.587275:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b4233c5/0x490975051af40dfc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.587285:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034719.587286:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034719.587289:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.587659:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786034719.587669:0:15040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b4233c5/0x490975051af40dfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786034719.588556:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786034719.588566:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eadf329/0x490975051af40e03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.588581:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1786034719.588586:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034719.588593:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eadf329/0x490975051af40e03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.588608:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eadf329/0x490975051af40e03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.588617:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eadf329/0x490975051af40e03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.588625:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004eadf329/0x490975051af40e03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.588645:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786034719.589058:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786034719.589071:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001377966f/0x490975051af40e0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.589079:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1786034719.589082:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034719.589086:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001377966f/0x490975051af40e0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.589096:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001377966f/0x490975051af40e0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.589105:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001377966f/0x490975051af40e0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.589112:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001377966f/0x490975051af40e0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.589121:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786034719.589489:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786034719.589495:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af40e11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.589503:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1786034719.589506:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034719.589510:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af40e11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.589520:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af40e11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.589535:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af40e11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.589554:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af40e11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.589564:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1786034719.589955:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786034719.589961:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a132bfc/0x490975051af40e18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.589969:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1786034719.589972:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034719.589975:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a132bfc/0x490975051af40e18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.589983:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a132bfc/0x490975051af40e18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.589991:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a132bfc/0x490975051af40e18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.589998:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a132bfc/0x490975051af40e18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.590017:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1786034719.590400:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786034719.590406:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050f48860/0x490975051af40e1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.590414:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1786034719.590417:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034719.590421:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050f48860/0x490975051af40e1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.590429:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050f48860/0x490975051af40e1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.590437:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050f48860/0x490975051af40e1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.590444:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050f48860/0x490975051af40e1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.590453:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1786034719.590842:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1786034719.590851:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004eadf329/0x490975051af40e03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.590861:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1e00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034719.590867:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004eadf329/0x490975051af40e03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.590876:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004eadf329/0x490975051af40e03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.590896:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004eadf329/0x490975051af40e03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.590905:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eadf329/0x490975051af40e03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786034719.590911:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786034719.590917:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009654f9f2/0x490975051af40e26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.590924:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1786034719.590932:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786034719.590932:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1786034719.590935:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001377966f/0x490975051af40e0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.590937:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009654f9f2/0x490975051af40e26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.590943:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:3.0:1786034719.590948:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009654f9f2/0x490975051af40e26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.590948:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001377966f/0x490975051af40e0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.590958:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009654f9f2/0x490975051af40e26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.590958:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001377966f/0x490975051af40e0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.590966:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009654f9f2/0x490975051af40e26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.590968:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001377966f/0x490975051af40e0a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.590974:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1786034719.590976:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001377966f/0x490975051af40e0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591002:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1786034719.591006:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af40e11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591013:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0e00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034719.591016:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af40e11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591035:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af40e11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591046:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af40e11 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786034719.591352:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786034719.591357:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbbd56a7/0x490975051af40e2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.591365:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1786034719.591368:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034719.591371:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbbd56a7/0x490975051af40e2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.591380:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbbd56a7/0x490975051af40e2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.591387:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbbd56a7/0x490975051af40e2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.591401:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbbd56a7/0x490975051af40e2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.591409:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1786034719.591581:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000767e893f/0x490975051af40e11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591596:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1786034719.591600:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a132bfc/0x490975051af40e18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591607:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f1c00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034719.591610:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a132bfc/0x490975051af40e18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591618:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a132bfc/0x490975051af40e18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591630:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a132bfc/0x490975051af40e18 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591637:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a132bfc/0x490975051af40e18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591662:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786034719.591666:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050f48860/0x490975051af40e1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591673:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0800 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034719.591676:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050f48860/0x490975051af40e1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591683:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050f48860/0x490975051af40e1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591693:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050f48860/0x490975051af40e1f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591700:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050f48860/0x490975051af40e1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.591703:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786034719.591711:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034719.591714:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbbd56a7/0x490975051af40e2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591720:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313e00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034719.591739:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbbd56a7/0x490975051af40e2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591756:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbbd56a7/0x490975051af40e2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591767:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbbd56a7/0x490975051af40e2d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591774:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbbd56a7/0x490975051af40e2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.591786:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034719.591787:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034719.591789:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034719.593630:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034719.593636:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034719.593638:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.593863:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009654f9f2/0x490975051af40e26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.593881:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312c00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034719.593886:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009654f9f2/0x490975051af40e26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.593910:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009654f9f2/0x490975051af40e26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.593931:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009654f9f2/0x490975051af40e26 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.593939:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009654f9f2/0x490975051af40e26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034719.593963:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.593964:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034719.593966:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786034719.601424:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786034719.601440:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afa86bc3/0x490975051af40e34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.601461:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1786034719.601467:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034719.601474:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afa86bc3/0x490975051af40e34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.601491:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afa86bc3/0x490975051af40e34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.601502:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afa86bc3/0x490975051af40e34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.601510:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afa86bc3/0x490975051af40e34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.601537:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786034719.601587:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034719.601596:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afa86bc3/0x490975051af40e34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.601606:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313c00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034719.601611:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afa86bc3/0x490975051af40e34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.601621:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afa86bc3/0x490975051af40e34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.601653:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afa86bc3/0x490975051af40e34 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.601661:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afa86bc3/0x490975051af40e34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.601683:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034719.601685:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034719.601687:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786034719.604206:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786034719.604221:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b92fdd60/0x490975051af40e3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.604246:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1786034719.604251:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786034719.604257:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b92fdd60/0x490975051af40e3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.604271:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b92fdd60/0x490975051af40e3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.604281:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b92fdd60/0x490975051af40e3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.604290:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b92fdd60/0x490975051af40e3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034719.604311:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786034719.604426:0:15267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034719.604434:0:15267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b92fdd60/0x490975051af40e3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.604443:0:15267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313a00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034719.604448:0:15267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b92fdd60/0x490975051af40e3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.604457:0:15267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b92fdd60/0x490975051af40e3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.604485:0:15267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b92fdd60/0x490975051af40e3b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.604494:0:15267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b92fdd60/0x490975051af40e3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034719.604526:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034719.604528:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034719.604529:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1786034719.604532:0:15040:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1786034719.604714:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14379:x1872792636204672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 168051us (168214us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034719.604729:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786034719.609949:0:14379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14379:1872792636204672:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1786034719.609976:0:14379:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1786034719.610049:0:14379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14379:1872792636204800:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1786034719.610125:0:14379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034719.610191:0:14379:0:(client.c:2702:ptlrpc_set_wait()) set ffff964551224600 going to sleep for 11 seconds 00000100:00100000:0.0:1786034719.610372:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636204800 00000100:00100000:0.0:1786034719.610380:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636204800 00000100:00100000:0.0:1786034719.610448:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786034719.610459:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14379:x1872792636204800:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1786034719.610694:0:15039:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1786034719.622220:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14379:x1872792636204800:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11754us (12087us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1786034719.622235:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786034719.622353:0:14379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14379:1872792636204800:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1786034719.622376:0:14379:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1786034719.869089:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034720.887643:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034721.912950:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034722.937660:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786034723.074892:0:6746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1786034723.074932:0:6746:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:02000400:3.0:1786034723.627646:0:15409:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1786034723.953494:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786034724.912776:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786034724.912784:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1786034724.912790:0:8:0:(import.c:65:import_set_state_nolock()) ffff964551259000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786034724.912800:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 555 00000100:00080000:2.0:1786034724.912807:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1786034724.912816:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff964551259000 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:2.0:1786034724.912865:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff964574df8380 x1872792636205184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786034724.912920:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636205440:0@lo:400:kworker.0 00000100:00100000:2.0:1786034724.913006:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034724.913074:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786034724.913080:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3309:1872792636204928:0@lo:400:kworker.0 00000100:00100000:2.0:1786034724.913112:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034724.913142:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636205056:0@lo:400:kworker.0 00000100:00100000:0.0:1786034724.913291:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636205184:0@lo:8:kworker.0 00000100:00100000:0.0:1786034724.913338:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636205568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786034724.913364:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034724.913401:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636205568 00000100:00100000:0.0:1786034724.913409:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636205568 00000100:00100000:0.0:1786034724.913475:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786034724.913485:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636205568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034724.913535:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034724.913583:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636205568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034724.913591:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1786034724.913616:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786034724.913648:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1786034724.913675:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636205568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034724.913779:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034724.913815:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786034724.913838:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636205312:0@lo:400:kworker.0 00000100:00100000:2.0:1786034724.913865:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034724.913895:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636205440 00000100:00100000:2.0:1786034724.913899:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636205440 00000100:00100000:2.0:1786034724.913934:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636205312 00000100:00100000:2.0:1786034724.913936:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636205312 00000100:00100000:2.0:1786034724.913951:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786034724.913957:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636205440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034724.913990:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636205440:12345-0@lo:400:kworker.0 Request processed in 33us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034724.914003:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786034724.914015:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786034724.914021:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636205312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034724.914054:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636205312:12345-0@lo:400:kworker.0 Request processed in 33us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034724.914059:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1786034724.914079:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786034724.914089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034724.914124:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636205056 00000100:00100000:2.0:1786034724.914127:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636205056 00000100:00100000:2.0:1786034724.914143:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636205184 00000100:00100000:2.0:1786034724.914145:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636205184 00000100:00100000:2.0:1786034724.914154:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786034724.914159:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636205056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034724.914259:0:15040:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1786034724.914272:0:15040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1786034724.914402:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786034724.914419:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1872792636205184:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1786034724.914437:0:15040:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786034724.915638:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636205056:12345-0@lo:400:kworker.0 Request processed in 1474us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034724.915649:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1786034724.915701:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964574dfad80 x1872792636205312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034724.915715:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636205312:0@lo:400:kworker.0 00000100:00100000:2.0:1786034724.915727:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636205056:0@lo:400:kworker.0 00010000:00080000:2.0:1786034724.915763:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964574df8e00 x1872792636205440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034724.915772:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636205440:0@lo:400:kworker.0 00000100:00100000:3.0:1786034724.915891:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636204928 00000100:00100000:3.0:1786034724.915899:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636204928 00000100:00100000:3.0:1786034724.915948:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786034724.915955:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:3309:x1872792636204928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034724.916010:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:3309:x1872792636204928:12345-0@lo:400:kworker.0 Request processed in 56us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034724.916017:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786034724.916064:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3309:1872792636204928:0@lo:400:kworker.0 00000100:00100000:2.0:1786034724.971015:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1872792636205184:12345-0@lo:8:kworker.0 Request processed in 56597us (56916us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786034724.971045:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1786034724.971084:0:3306:0:(import.c:65:import_set_state_nolock()) ffff964551259000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786034724.971096:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786034724.971102:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636205184:0@lo:8:kworker.0 00010000:00010000:2.0:1786034724.980398:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034726.005272:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786034726.513418:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1786034727.024034:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034728.048440:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034729.074691:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034730.032107:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786034730.032140:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636205696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786034730.032229:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034730.032622:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636205696 00000100:00100000:1.0:1786034730.032632:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636205696 00000100:00100000:1.0:1786034730.032712:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786034730.032724:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636205696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786034730.032770:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034730.032856:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636205696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034730.032864:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786034730.032918:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636205696:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786034730.033036:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786034730.033697:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1786034730.033702:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1786034730.033707:0:37:0:(import.c:65:import_set_state_nolock()) ffff964551259000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786034730.033713:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 561 00000100:00080000:0.0:1786034730.033718:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786034730.033723:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff964551259000 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:0.0:1786034730.033745:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9644476c3b80 x1872792636205952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786034730.033806:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636205952:0@lo:8:kworker.0 00000100:00100000:0.0:1786034730.033861:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034730.033905:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636206080:0@lo:400:kworker.0 00000100:00100000:0.0:1786034730.033934:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034730.033956:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034730.033962:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636206208:0@lo:400:kworker.0 00000100:00100000:0.0:1786034730.034001:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034730.034035:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636205952 00000100:00100000:0.0:1786034730.034040:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636205952 00000100:00100000:0.0:1786034730.034068:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786034730.034087:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1872792636205952:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1786034730.034106:0:15041:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786034730.034789:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786034730.034801:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3307:1872792636205824:0@lo:400:kworker.0 00000100:00100000:2.0:1786034730.034851:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034730.038567:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636206080 00000100:00100000:1.0:1786034730.038591:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636206080 00000100:00100000:1.0:1786034730.038653:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636206208 00000100:00100000:1.0:1786034730.038657:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636206208 00000100:00100000:1.0:1786034730.038686:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786034730.038695:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636206080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034730.038795:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636206080:12345-0@lo:400:kworker.0 Request processed in 101us (4860us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034730.038803:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786034730.038818:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786034730.038842:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636206208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034730.038868:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636206208:12345-0@lo:400:kworker.0 Request processed in 45us (4867us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034730.038874:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1786034730.038896:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786034730.039013:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9644476c0a80 x1872792636206208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034730.039030:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636206208:0@lo:400:kworker.0 00010000:00080000:1.0:1786034730.039073:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9644476c3480 x1872792636206080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034730.039141:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636206080:0@lo:400:kworker.0 00000100:00100000:0.0:1786034730.056149:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636205824 00000100:00100000:0.0:1786034730.056160:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636205824 00000100:00100000:1.0:1786034730.056860:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1872792636205952:12345-0@lo:8:kworker.0 Request processed in 22768us (22995us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786034730.056871:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1786034730.056912:0:3306:0:(import.c:65:import_set_state_nolock()) ffff964551259000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786034730.056917:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786034730.056922:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636205952:0@lo:8:kworker.0 00000100:00100000:0.0:1786034730.057356:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786034730.057367:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:3307:x1872792636205824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034730.057417:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:3307:x1872792636205824:12345-0@lo:400:kworker.0 Request processed in 53us (22565us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034730.057440:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786034730.057493:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3307:1872792636205824:0@lo:400:kworker.0 00010000:00010000:2.0:1786034730.097995:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034731.122682:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034732.146488:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034733.170189:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1786034733.513588:0:15761:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1786034733.513592:0:15761:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1786034733.515888:0:15761:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff96457d631000 00000020:01000004:0.0:1786034733.515904:0:15761:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1786034733.515918:0:15761:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1786034733.515930:0:15761:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96455191b380) 00000020:00000080:0.0:1786034733.515945:0:15761:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1786034733.569359:0:15761:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1786034733.569646:0:15761:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1786034733.570414:0:15761:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1786034733.576981:0:15761:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1786034733.577788:0:15761:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1786034733.578242:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 517: rc = 0 00100000:10000000:2.0:1786034733.578532:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 517: rc = 0 00100000:10000000:2.0:1786034733.578623:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 517: rc = 0 00100000:10000000:2.0:1786034733.579297:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 642: rc = 0 00100000:10000000:2.0:1786034733.579616:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 642: rc = 0 00100000:10000000:2.0:1786034733.580313:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:2.0:1786034733.585070:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:2.0:1786034733.585491:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 642: rc = 0 00100000:10000000:2.0:1786034733.586429:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 642: rc = 0 00000020:00000080:2.0:1786034733.587019:0:15761:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1786034733.587030:0:15761:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1786034733.587040:0:15761:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x490975051af40e49 00000020:01000004:2.0:1786034733.587048:0:15761:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1786034733.587068:0:15761:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.156@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1786034733.587071:0:15761:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1786034733.587077:0:15761:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1786034733.587098:0:15761:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1786034733.587282:0:15761:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.156@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1786034733.615073:0:15761:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786034733.619797:0:15761:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.156@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1786034733.619804:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786034733.619806:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786034733.619807:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034733.619808:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786034733.619809:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034733.619811:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034733.619812:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786034733.619814:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034733.619815:0:15761:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786034733.619819:0:15761:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1786034733.619965:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786034733.619966:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786034733.619968:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034733.619969:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786034733.619970:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034733.619971:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034733.619972:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786034733.619973:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034733.619974:0:15761:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786034733.620020:0:15761:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1786034733.620039:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636206336:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786034733.620113:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034733.621021:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454adbf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034733.628241:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636206336 00000100:00100000:0.0:1786034733.628269:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636206336 00000100:00100000:0.0:1786034733.628337:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786034733.628348:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15761:x1872792636206336:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1786034733.628381:0:14350:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1786034733.628384:0:14350:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1786034733.628388:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1786034733.651533:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15761:x1872792636206336:12345-0@lo:253:mount.lustre.0 Request processed in 23178us (31410us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034733.651548:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1786034733.651819:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636206336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1786034733.651853:0:15761:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1786034733.651856:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786034733.651858:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786034733.651859:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786034733.651860:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786034733.651862:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786034733.651863:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786034733.651865:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786034733.651867:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786034733.651882:0:15761:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1786034733.651904:0:15761:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96457d631000 from lustre-OST0001 10000000:01000000:2.0:1786034733.651930:0:15761:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1786034733.651933:0:15761:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1786034733.651940:0:15761:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9645519a4d40 local copy 00010000:00010000:2.0:1786034733.651950:0:15761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1000/0x490975051af40bef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40bf6 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034733.652209:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636206464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786034733.652245:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034733.652281:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454adbfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1786034733.652435:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636206464 00000100:00100000:0.0:1786034733.652441:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636206464 00000100:00100000:0.0:1786034733.652490:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1786034733.652499:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457477a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15761:x1872792636206464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786034733.652686:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457477a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15761:x1872792636206464:12345-0@lo:501:mount.lustre.0 Request processed in 188us (439us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786034733.652694:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1786034733.652779:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636206464:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1786034733.652792:0:15761:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1786034733.652984:0:15761:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1786034733.652991:0:15761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff9645413f1000/0x490975051af40bef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40bf6 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034733.653001:0:15761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff9645413f1000/0x490975051af40bef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40bf6 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034733.653021:0:15761:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96457d631000 10000000:01000000:3.0:1786034733.653026:0:15761:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1786034733.653030:0:15761:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1786034733.653033:0:15761:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786034733.653037:0:15761:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1786034733.653040:0:15761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1786034733.653061:0:15761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562312000/0x490975051af40e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034733.653069:0:15761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964562312000/0x490975051af40e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034733.653089:0:15761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964562312000/0x490975051af40e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034733.653103:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636206592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786034733.653131:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034733.654295:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645627026c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034733.654362:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636206592 00000100:00100000:0.0:1786034733.654369:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636206592 00000100:00100000:0.0:1786034733.654407:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786034733.654414:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457477bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:15761:x1872792636206592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786034733.654425:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034733.654438:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df8400/0x490975051af40e57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40e50 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034733.654470:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df8400/0x490975051af40e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40e50 expref: 17 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034733.654480:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df8400/0x490975051af40e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40e50 expref: 17 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034733.654498:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8400, rc 0) 00000100:00100000:0.0:1786034733.654547:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457477bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:15761:x1872792636206592:12345-0@lo:101:mount.lustre.0 Request processed in 134us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034733.654554:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786034733.654642:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636206592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786034733.654656:0:15761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964562312000/0x490975051af40e50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40e57 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.654664:0:15761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964562312000/0x490975051af40e50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40e57 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786034733.655285:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1786034733.656096:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786034733.656327:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1786034733.656373:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1786034733.656411:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1786034733.656470:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1786034733.656510:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1786034733.656545:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1786034733.656623:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1786034733.656632:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1786034733.656692:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636206720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786034733.656743:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034733.656772:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff964559e370c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034733.657300:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636206720 00000100:00100000:0.0:1786034733.657307:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636206720 00000100:00100000:0.0:1786034733.657336:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786034733.657344:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457477b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:15761:x1872792636206720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786034733.657739:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457477b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:15761:x1872792636206720:12345-0@lo:501:mount.lustre.0 Request processed in 394us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034733.657746:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786034733.659375:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636206720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786034733.660259:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636206848:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786034733.660324:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034733.660405:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff964559e370c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034733.663940:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636206848 00000100:00100000:0.0:1786034733.663953:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636206848 00000100:00100000:1.0:1786034733.664096:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1786034733.664106:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457477a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:15761:x1872792636206848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786034733.664503:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457477a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:15761:x1872792636206848:12345-0@lo:503:mount.lustre.0 Request processed in 398us (4177us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034733.664511:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1786034733.664802:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636206848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1786034733.665655:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786034733.665725:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636206976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786034733.665776:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034733.665816:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454adbf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034733.667322:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636206976 00000100:00100000:0.0:1786034733.667330:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636206976 00000100:00100000:0.0:1786034733.667381:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786034733.667390:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:15761:x1872792636206976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786034733.667655:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:15761:x1872792636206976:12345-0@lo:502:mount.lustre.0 Request processed in 265us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034733.667663:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1786034733.667862:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636206976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1786034733.668094:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1786034733.668255:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1786034733.668295:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1786034733.668346:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1786034733.668385:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1786034733.668419:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1786034733.678655:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1786034733.678724:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1786034733.678767:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1786034733.678813:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636207104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786034733.678907:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034733.678941:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff964562702180 going to sleep for 11 seconds 00000100:00100000:0.0:1786034733.679054:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636207104 00000100:00100000:0.0:1786034733.679061:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636207104 00000100:00100000:0.0:1786034733.679116:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786034733.679124:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:15761:x1872792636207104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786034733.679695:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:15761:x1872792636207104:12345-0@lo:502:mount.lustre.0 Request processed in 571us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034733.679711:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786034733.681200:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636207104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786034733.681308:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1786034733.681591:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1786034733.682812:0:15762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1786034733.682820:0:15762:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1786034733.682858:0:15762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786034733.682861:0:15762:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1786034733.682868:0:15762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786034733.682897:0:15762:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9644450199c0) 00000020:00000080:3.0:1786034733.682920:0:15762:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1786034733.682927:0:15762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1786034733.682985:0:15762:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96457d631000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1786034733.682992:0:15762:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1786034733.682999:0:15762:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x490975051af40e65 00010000:00010000:2.0:1786034733.693523:0:15762:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1786034733.695545:0:15762:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1786034733.701110:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1786034733.721488:0:15762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1786034733.721501:0:15762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786034733.721515:0:15762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034733.721517:0:15762:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1786034733.721521:0:15762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786034733.721525:0:15762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034733.721527:0:15762:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786034733.721530:0:15762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786034733.721532:0:15762:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1786034733.721534:0:15762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786034733.721537:0:15762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034733.721538:0:15762:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1786034733.721541:0:15762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786034733.721543:0:15762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034733.721544:0:15762:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1786034733.721548:0:15762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1786034733.721611:0:15762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786034733.721615:0:15762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786034733.721616:0:15762:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1786034733.721620:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1786034733.729495:0:15761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1786034733.729534:0:15761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1786034733.729556:0:15761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562312000/0x490975051af40e50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40e57 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034733.729568:0:15761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964562312000/0x490975051af40e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40e57 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034733.729599:0:15761:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96457d631000 from 1 10000000:01000000:3.0:1786034733.729602:0:15761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786034733.729635:0:15761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034733.729643:0:15761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034733.729654:0:15761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034733.729679:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636207232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786034733.729742:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034733.729789:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff964562702840 going to sleep for 11 seconds 00000100:00100000:2.0:1786034733.729919:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636207232 00000100:00100000:2.0:1786034733.729926:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636207232 00000100:00100000:2.0:1786034733.729965:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1786034733.729974:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:15761:x1872792636207232:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786034733.729987:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034733.730000:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964548aa7600/0x490975051af40e73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40e6c expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034733.730023:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964548aa7600/0x490975051af40e73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40e6c expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034733.730033:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964548aa7600/0x490975051af40e73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40e6c expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034733.730041:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7600, rc 0) 00000100:00100000:2.0:1786034733.730094:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:15761:x1872792636207232:12345-0@lo:101:mount.lustre.0 Request processed in 120us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034733.730101:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1786034733.731261:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636207232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786034733.731278:0:15761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40e73 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034733.731288:0:15761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40e73 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786034733.731860:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1786034733.735530:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786034733.735802:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1786034733.735985:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1786034733.736058:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1786034733.736067:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1786034733.736628:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636207360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786034733.736688:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034733.737613:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff96457513e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034733.744084:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636207360 00000100:00100000:2.0:1786034733.744098:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636207360 00000100:00100000:2.0:1786034733.745479:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1786034733.745491:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:15761:x1872792636207360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786034733.745791:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:15761:x1872792636207360:12345-0@lo:501:mount.lustre.0 Request processed in 302us (9103us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034733.745800:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1786034733.746902:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636207360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786034733.746960:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636207488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786034733.747012:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034733.747043:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff96458093a600 going to sleep for 11 seconds 00000100:00100000:3.0:1786034733.747102:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636207488 00000100:00100000:3.0:1786034733.747108:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636207488 00000100:00100000:3.0:1786034733.747164:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1786034733.747171:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:15761:x1872792636207488:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786034733.747557:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:15761:x1872792636207488:12345-0@lo:503:mount.lustre.0 Request processed in 386us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034733.747565:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1786034733.747640:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636207488:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1786034733.748616:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786034733.748679:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636207616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786034733.748721:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034733.748741:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff96458093a600 going to sleep for 11 seconds 00000100:00100000:3.0:1786034733.748854:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636207616 00000100:00100000:3.0:1786034733.748860:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636207616 00000100:00100000:3.0:1786034733.748890:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1786034733.748897:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:15761:x1872792636207616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786034733.749055:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:15761:x1872792636207616:12345-0@lo:502:mount.lustre.0 Request processed in 157us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034733.749063:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786034733.749391:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636207616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786034733.749627:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1786034733.749686:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1786034733.749762:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1786034733.749805:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1786034733.749870:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1786034733.749914:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1786034733.749946:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1786034733.749978:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1786034733.750000:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636207744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786034733.750038:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034733.750059:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff96458093a600 going to sleep for 11 seconds 00000100:00100000:2.0:1786034733.750261:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636207744 00000100:00100000:2.0:1786034733.750267:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636207744 00000100:00100000:2.0:1786034733.750295:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786034733.750303:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:15761:x1872792636207744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786034733.750465:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:15761:x1872792636207744:12345-0@lo:502:mount.lustre.0 Request processed in 162us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034733.750472:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1786034733.752010:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636207744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786034733.752124:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1786034733.752409:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1786034733.754636:0:15766:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786034733.754646:0:15766:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034733.754649:0:15766:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1786034733.754656:0:15766:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96457d631000 00000020:00000080:1.0:1786034733.754658:0:15766:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786034733.754666:0:15766:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786034733.754669:0:15766:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034733.754670:0:15766:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1786034733.754672:0:15766:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786034733.754674:0:15766:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034733.754676:0:15766:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1786034733.754679:0:15766:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96457d631000 00000020:00000080:1.0:1786034733.754681:0:15766:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786034733.754770:0:15766:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786034733.754775:0:15766:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034733.754776:0:15766:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1786034733.754779:0:15766:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786034733.754782:0:15766:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034733.754783:0:15766:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1786034733.754787:0:15766:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96457d631000 00000020:00000080:1.0:1786034733.754801:0:15766:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786034733.761660:0:15766:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786034733.761670:0:15766:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786034733.761673:0:15766:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1786034733.761677:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1786034733.761887:0:15761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1786034733.761913:0:15761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786034733.761935:0:15761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40e73 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034733.761947:0:15761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40e73 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786034733.761989:0:15761:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1786034733.761992:0:15761:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96457d631000 10000000:01000000:2.0:1786034733.761995:0:15761:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96457d631000 10000000:01000000:2.0:1786034733.762007:0:15761:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786034733.762013:0:15761:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96457d631000 from 1 10000000:01000000:2.0:1786034733.762015:0:15761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786034733.762047:0:15761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964548aa6c00/0x490975051af40e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034733.762056:0:15761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964548aa6c00/0x490975051af40e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034733.762068:0:15761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964548aa6c00/0x490975051af40e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034733.762091:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636207872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1786034733.762172:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034733.762214:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454adbfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1786034733.762608:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636207872 00000100:00100000:1.0:1786034733.762616:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636207872 00000100:00100000:1.0:1786034733.762695:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1786034733.762705:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:15761:x1872792636207872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786034733.762719:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034733.762731:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96444724a200/0x490975051af40e81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40e7a expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.762753:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96444724a200/0x490975051af40e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40e7a expref: 19 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.762764:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96444724a200/0x490975051af40e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40e7a expref: 19 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.762772:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724a200, rc 0) 00000100:00100000:1.0:1786034733.762816:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:15761:x1872792636207872:12345-0@lo:101:mount.lustre.0 Request processed in 113us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034733.762849:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1786034733.785669:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636207872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786034733.785694:0:15761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964548aa6c00/0x490975051af40e7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40e81 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.785707:0:15761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964548aa6c00/0x490975051af40e7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40e81 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786034733.787577:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1786034733.787931:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786034733.791513:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1786034733.791600:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1786034733.791634:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1786034733.791682:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1786034733.791718:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1786034733.791766:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1786034733.791819:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1786034733.791873:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1786034733.791921:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1786034733.791956:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1786034733.791989:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1786034733.792037:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1786034733.792073:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1786034733.792104:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1786034733.795498:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1786034733.795585:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1786034733.795620:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1786034733.795672:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1786034733.795710:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1786034733.795746:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1786034733.795816:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1786034733.795883:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1786034733.795931:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1786034733.795975:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1786034733.796009:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1786034733.796044:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1786034733.796094:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1786034733.796132:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1786034733.799259:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1786034733.803027:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1786034733.803102:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1786034733.803143:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1786034733.803178:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1786034733.803215:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1786034733.803242:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1786034733.803293:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1786034733.803439:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1786034733.803538:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1786034733.803545:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1786034733.803635:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636208000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786034733.803689:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034733.803727:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636208000 00000100:00100000:1.0:1786034733.803734:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636208000 00000100:00100000:1.0:1786034733.803773:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786034733.803780:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:15761:x1872792636208000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786034733.803971:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:15761:x1872792636208000:12345-0@lo:501:mount.lustre.0 Request processed in 191us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034733.803978:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786034733.804016:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff96458093a600 going to sleep for 11 seconds 00000100:00100000:1.0:1786034733.804033:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636208000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786034733.804060:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636208128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786034733.804091:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034733.804109:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636208128 00000100:00100000:1.0:1786034733.804112:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636208128 00000100:00100000:1.0:1786034733.804129:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786034733.804134:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457e022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:15761:x1872792636208128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786034733.805609:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457e022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:15761:x1872792636208128:12345-0@lo:503:mount.lustre.0 Request processed in 1470us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034733.805623:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786034733.805664:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff96458093a600 going to sleep for 11 seconds 00000100:00100000:1.0:1786034733.805677:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636208128:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1786034733.806116:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786034733.806187:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636208256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786034733.806223:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034733.806248:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636208256 00000100:00100000:1.0:1786034733.806252:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636208256 00000100:00100000:1.0:1786034733.806275:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1786034733.806281:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:15761:x1872792636208256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786034733.811081:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:15761:x1872792636208256:12345-0@lo:502:mount.lustre.0 Request processed in 4791us (4849us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034733.811095:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1786034733.813406:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff96458093a600 going to sleep for 11 seconds 00000100:00100000:1.0:1786034733.813436:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636208256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786034733.813763:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1786034733.813848:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1786034733.813890:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1786034733.813940:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1786034733.813978:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1786034733.814025:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1786034733.814059:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1786034733.814087:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1786034733.814130:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1786034733.814463:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1786034733.814499:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1786034733.814548:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1786034733.814598:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1786034733.814651:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1786034733.814702:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1786034733.814737:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1786034733.814770:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1786034733.814817:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1786034733.814884:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1786034733.814919:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1786034733.814967:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1786034733.815003:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1786034733.815037:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1786034733.815084:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1786034733.815122:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1786034733.817492:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1786034733.817566:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1786034733.817606:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1786034733.817643:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1786034733.817722:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1786034733.817759:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1786034733.817792:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1786034733.817852:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1786034733.817906:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1786034733.817943:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1786034733.817994:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1786034733.818033:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1786034733.818068:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1786034733.818115:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1786034733.825500:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1786034733.825567:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636208384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786034733.825646:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034733.825688:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff96457513e180 going to sleep for 11 seconds 00000100:00100000:3.0:1786034733.826643:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636208384 00000100:00100000:3.0:1786034733.826651:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636208384 00000100:00100000:3.0:1786034733.826708:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1786034733.826717:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:15761:x1872792636208384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786034733.832104:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:15761:x1872792636208384:12345-0@lo:502:mount.lustre.0 Request processed in 5381us (6450us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034733.832116:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786034733.832355:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636208384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786034733.832480:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1786034733.832494:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1786034733.838436:0:15771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1786034733.838463:0:15771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff964551918000) 00000020:00000080:0.0:1786034733.838486:0:15771:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1786034733.838642:0:15771:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96457d631000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1786034733.838646:0:15771:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96457d631000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1786034733.838649:0:15771:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96457d631000 3 00010000:00080000:0.0:1786034733.838688:0:15771:0:(ldlm_lib.c:102:import_set_conn()) imp ffff964447919800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.156@tcp at head 00010000:00010000:0.0:1786034733.840312:0:15771:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1786034733.840392:0:15771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1786034733.840421:0:15771:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1786034733.840430:0:15771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x490975051af40e8f 00000100:00080000:0.0:1786034733.840440:0:15771:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786034733.840462:0:15771:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff964447919800 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:0.0:1786034733.840492:0:15771:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9644476c0700 x1872792636208512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786034733.840520:0:15771:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1786034733.843905:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1872792636208512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1786034733.843976:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034733.846386:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636208512 00000100:00100000:1.0:1786034733.846397:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636208512 00000100:00100000:1.0:1786034733.846441:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786034733.846457:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1872792636208512:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1786034733.846483:0:14356:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:1.0:1786034733.846526:0:14356:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x490975051af40e96 00000004:00100000:1.0:1786034733.846542:0:14356:0:(mdt_handler.c:7332:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786034733.846576:0:14356:0:(import.c:65:import_set_state_nolock()) ffff964558cfd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786034733.846648:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1872792636208512:12345-0@lo:38:llog_process_th.0 Request processed in 190us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034733.846655:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1786034733.846900:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9644476c0700 x1872792636208512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786034743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034733.846911:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786034733.846919:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1786034733.846926:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1786034733.846931:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1786034733.846933:0:3306:0:(import.c:65:import_set_state_nolock()) ffff964447919800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1786034733.846938:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1872792636208512:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1786034733.848596:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1786034733.849391:0:15761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1786034733.849419:0:15761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786034733.849436:0:15761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964548aa6c00/0x490975051af40e7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40e81 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034733.849457:0:15761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964548aa6c00/0x490975051af40e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40e81 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1786034733.849502:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1786034733.849504:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786034733.849506:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786034733.849507:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786034733.849509:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786034733.849510:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786034733.849511:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786034733.849513:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786034733.849514:0:15761:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786034733.849518:0:15761:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1786034733.849520:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786034733.849521:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786034733.849522:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786034733.849523:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786034733.849524:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786034733.849526:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786034733.849527:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786034733.849528:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786034733.849529:0:15761:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786034733.849549:0:15761:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1786034733.849566:0:15761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636208640:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1786034733.849616:0:15761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034733.849649:0:15761:0:(client.c:2702:ptlrpc_set_wait()) set ffff96457513e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034733.849747:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636208640 00000100:00100000:1.0:1786034733.849753:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636208640 00000100:00100000:1.0:1786034733.849794:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1786034733.849802:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:15761:x1872792636208640:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1786034733.849841:0:14348:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1786034733.849855:0:14348:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1786034733.852353:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786034733.852358:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1786034733.852362:0:37:0:(import.c:65:import_set_state_nolock()) ffff964551259000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786034733.852368:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 566 00000100:00080000:2.0:1786034733.852372:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1786034733.852378:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff964551259000 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:2.0:1786034733.852397:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff964574df9500 x1872792636208896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786034733.852463:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636208768:0@lo:400:kworker.0 00000100:00100000:2.0:1786034733.852510:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034733.852550:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786034733.852556:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636209024:0@lo:400:kworker.0 00000100:00100000:2.0:1786034733.852581:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034733.852604:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786034733.852611:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636209152:0@lo:400:kworker.0 00000100:00100000:2.0:1786034733.852632:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034733.852658:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636208768 00000100:00100000:2.0:1786034733.852664:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636208768 00000100:00100000:2.0:1786034733.852711:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786034733.852718:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636208768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034733.852764:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636208768:12345-0@lo:400:kworker.0 Request processed in 46us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034733.852771:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786034733.852807:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636208768:0@lo:400:kworker.0 00000100:00100000:1.0:1786034733.853404:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636209024 00000100:00100000:1.0:1786034733.853409:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636209024 00000100:00100000:1.0:1786034733.853455:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636209152 00000100:00100000:1.0:1786034733.853458:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636209152 00000100:00100000:1.0:1786034733.853475:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786034733.853481:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636209024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034733.853528:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636209024:12345-0@lo:400:kworker.0 Request processed in 46us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034733.853535:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786034733.853551:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786034733.853557:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636209152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034733.853598:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636209152:12345-0@lo:400:kworker.0 Request processed in 40us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034733.853604:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1786034733.853620:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786034733.853625:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786034733.853642:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964574df9180 x1872792636209024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786034733.853653:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636209024:0@lo:400:kworker.0 00000100:00100000:1.0:1786034733.853672:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636208896:0@lo:8:kworker.0 00000100:00100000:1.0:1786034733.853699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034733.853726:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636208896 00000100:00100000:1.0:1786034733.853730:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636208896 00000100:00100000:1.0:1786034733.853750:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786034733.853755:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1872792636208896:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1786034733.853798:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1872792636208896:12345-0@lo:8:kworker.0 Request processed in 41us (98us total) trans 0 rc -11/-11 00000100:00100000:1.0:1786034733.853804:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786034733.853849:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786034733.853855:0:3306:0:(import.c:65:import_set_state_nolock()) ffff964551259000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786034733.853858:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1786034733.853861:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636208896:0@lo:8:kworker.0 00010000:00080000:0.0:1786034733.854290:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff964574df8e00 x1872792636209152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034733.854300:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636209152:0@lo:400:kworker.0 20000000:01000000:1.0:1786034733.902136:0:14348:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1786034733.902152:0:14348:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1786034733.902726:0:14372:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1786034733.902732:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1786034733.902754:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034733.902772:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964574d00a00/0x490975051af40d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40d69 expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034733.902780:0:14372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034733.902818:0:14372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964574d00a00/0x490975051af40d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af40d69 expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034733.902868:0:14372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964574d00a00/0x490975051af40d70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af40d69 expref: 19 pid: 14351 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034733.902883:0:14372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1872792636209280:0@lo:104: 00000100:00100000:2.0:1786034733.903984:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034733.904031:0:14372:0:(client.c:2702:ptlrpc_set_wait()) set ffff96457513eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786034733.904135:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636209280 00000100:00100000:1.0:1786034733.904142:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636209280 00000100:00100000:1.0:1786034733.904190:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786034733.904199:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+3:14372:x1872792636209280:12345-0@lo:104: 00010000:00010000:1.0:1786034733.904211:0:14340:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af40d70 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.904300:0:14340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786034733.904307:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+3:14372:x1872792636209280:12345-0@lo:104: Request processed in 109us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034733.904315:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1786034733.904352:0:15267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034733.904359:0:15267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af40d70 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034733.904367:0:15267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0200 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034733.904371:0:15267:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af40d70 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034733.904391:0:15267:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af40d70 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034733.904398:0:15267:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af40d70 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034733.904404:0:15267:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1786034733.904440:0:15267:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40d70 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034733.904456:0:15267:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034733.904478:0:15267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40d70 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034733.904486:0:15267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff9645413f0200/0x490975051af40d69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40d70 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034733.904501:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034733.904503:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034733.904505:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034733.904513:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034733.904523:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3309:1872792636209408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034733.904553:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034733.904682:0:14372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1872792636209280:0@lo:104: 00010000:00010000:2.0:1786034733.904701:0:14372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034733.905130:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636209408 00000100:00100000:1.0:1786034733.905135:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636209408 00010000:00010000:1.0:1786034733.905151:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964574d00a00/0x490975051af40d70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af40d69 expref: 20 pid: 14351 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034733.905179:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786034733.905186:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+20:3309:x1872792636209408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786034733.905196:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034733.905202:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964574d00a00/0x490975051af40d70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af40d69 expref: 20 pid: 14351 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.905214:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964574d00a00/0x490975051af40d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af40d69 expref: 20 pid: 14351 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.905229:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964574d00a00/0x490975051af40d70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af40d69 expref: 20 pid: 14351 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.905255:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.905263:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786034733.905284:0:14341:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009911999s 00010000:00010000:1.0:1786034733.905288:0:14341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.905295:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.905302:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.905308:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.905314:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034733.905318:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.905326:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.905348:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034733.905358:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034733.905399:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3309:x1872792636209408:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034733.905406:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1786034733.905421:0:14372:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034733.905430:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034733.905436:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964542df9400/0x490975051af40e9d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034733.905504:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3309:1872792636209408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786034733.933476:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:15761:x1872792636208640:12345-0@lo:253:mount.lustre.0 Request processed in 83664us (83849us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034733.933491:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786034733.933505:0:15761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e73795d0-2313-4f03-984a-ce7ce1eccbf3:15761:1872792636208640:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786034733.933526:0:15761:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1786034733.933530:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786034733.933532:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786034733.933533:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786034733.933535:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786034733.933549:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786034733.933551:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786034733.933552:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786034733.933553:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786034733.933555:0:15761:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1786034733.933569:0:15761:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1786034733.946762:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1786034733.946960:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1786034733.947114:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1786034733.947249:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1786034733.947391:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1786034733.947552:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1786034733.953779:0:15761:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1786034734.084486:0:15761:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1786034734.084496:0:15761:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1786034734.084530:0:15761:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1786034734.084605:0:15761:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.156@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1786034734.084622:0:15761:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1786034734.084649:0:15761:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1786034734.192132:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034735.152454:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786034735.152491:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636209536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786034735.152560:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034735.152660:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636209536 00000100:00100000:0.0:1786034735.152668:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636209536 00000100:00100000:0.0:1786034735.152736:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786034735.152745:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636209536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034735.152774:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034735.152818:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636209536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034735.152850:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786034735.152950:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636209536:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786034735.153093:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786034735.217233:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1786034735.471914:0:14353:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1786034735.471921:0:14353:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9645751e6000 from 8 10000000:01000000:1.0:1786034735.471926:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786034735.471969:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff96444724ae00/0x490975051af40ea4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034735.471980:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff96444724ae00/0x490975051af40ea4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034735.471992:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff96444724ae00/0x490975051af40ea4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034735.472015:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636209664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786034735.472074:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034735.472118:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d58180 going to sleep for 11 seconds 00000100:00100000:2.0:1786034735.474358:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636209664 00000100:00100000:2.0:1786034735.474369:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636209664 00000100:00100000:2.0:1786034735.474426:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1786034735.474448:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:14353:x1872792636209664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786034735.474461:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034735.474477:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964548aa7200/0x490975051af40eab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40ea4 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034735.474510:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964548aa7200/0x490975051af40eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40ea4 expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034735.474520:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964548aa7200/0x490975051af40eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40ea4 expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034735.474529:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7200, rc 0) 00000100:00100000:2.0:1786034735.474595:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:14353:x1872792636209664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (2520us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034735.474602:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786034735.475100:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636209664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034735.475116:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff96444724ae00/0x490975051af40ea4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40eab expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034735.475124:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff96444724ae00/0x490975051af40ea4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af40eab expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034735.475184:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636209792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786034735.475216:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034735.475234:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454ad069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034735.475509:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636209792 00000100:00100000:1.0:1786034735.475514:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636209792 00000100:00100000:1.0:1786034735.475545:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786034735.475552:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:14353:x1872792636209792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1786034735.475569:0:14350:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1786034735.475585:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1786034735.475587:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1786034735.475670:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:14353:x1872792636209792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034735.475678:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1786034735.476411:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636209792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1786034735.476480:0:14353:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786034735.476487:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff96444724ae00/0x490975051af40ea4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40eab expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034735.476503:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff96444724ae00/0x490975051af40ea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af40eab expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034736.249037:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786034736.754599:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1786034737.264206:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034738.296848:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786034739.248337:0:10438:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786034739.248354:0:10438:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1786034739.248358:0:10438:0:(import.c:65:import_set_state_nolock()) ffff964551259000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786034739.248369:0:10438:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff964551259000 using connection 192.168.203.156@tcp/0@lo 00000100:00100000:1.0:1786034739.248389:0:10438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9645412aaa00 x1872792636210176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786034739.248460:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636210176:0@lo:8:kworker.0 00000100:00100000:1.0:1786034739.248516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034739.248605:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636210432:0@lo:400:kworker.0 00000100:00100000:2.0:1786034739.248646:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034739.248673:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786034739.248687:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3307:1872792636209920:0@lo:400:kworker.0 00000100:00100000:2.0:1786034739.248715:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034739.248744:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636210560:0@lo:400:kworker.0 00000100:00100000:2.0:1786034739.248768:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034739.248789:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636210048:0@lo:400:kworker.0 00000100:00100000:2.0:1786034739.248808:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034739.248841:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786034739.248846:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636210304:0@lo:400:kworker.0 00000100:00100000:2.0:1786034739.248864:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034739.248888:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636210176 00000100:00100000:2.0:1786034739.248894:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636210176 00000100:00100000:2.0:1786034739.248919:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636210048 00000100:00100000:2.0:1786034739.248921:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636210048 00000100:00100000:2.0:1786034739.248953:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786034739.248961:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636210048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034739.249002:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636210048:12345-0@lo:400:kworker.0 Request processed in 42us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034739.249008:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786034739.249021:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786034739.249025:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1872792636210176:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1786034739.249047:0:15040:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:2.0:1786034739.249073:0:15040:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x490975051af40eb2 00002000:00100000:2.0:1786034739.249085:0:15040:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff964447bc3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113834 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1786034739.249089:0:15040:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1786034739.249092:0:15040:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1786034739.249222:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636210432 00000100:00100000:1.0:1786034739.249226:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636210432 00000100:00100000:1.0:1786034739.249250:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636210560 00000100:00100000:1.0:1786034739.249253:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636210560 00000100:00100000:1.0:1786034739.249264:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636210304 00000100:00100000:1.0:1786034739.249266:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636210304 00000100:00100000:1.0:1786034739.249277:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786034739.249282:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636210432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034739.249317:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636210432:12345-0@lo:400:kworker.0 Request processed in 34us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034739.249323:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786034739.249336:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786034739.249341:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636210560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034739.249362:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636210560:12345-0@lo:400:kworker.0 Request processed in 21us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034739.249367:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786034739.249376:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786034739.249381:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636210304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034739.249399:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636210304:12345-0@lo:400:kworker.0 Request processed in 19us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034739.249423:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00002000:00080000:2.0:1786034739.250034:0:15040:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1786034739.250055:0:15040:0:(import.c:65:import_set_state_nolock()) ffff964447bc5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786034739.251041:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636209920 00000100:00100000:3.0:1786034739.251050:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636209920 00000100:00100000:3.0:1786034739.251085:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1786034739.251112:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3307:x1872792636209920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034739.252344:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1872792636210176:12345-0@lo:8:kworker.0 Request processed in 3311us (3822us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034739.252363:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1786034739.252392:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786034739.252398:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786034739.252445:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9645412a9500 x1872792636210304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034739.252460:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636210304:0@lo:400:kworker.0 00000100:00100000:2.0:1786034739.252473:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636210048:0@lo:400:kworker.0 00010000:00080000:2.0:1786034739.252505:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9645412a8a80 x1872792636210560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034739.252514:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636210560:0@lo:400:kworker.0 00010000:00080000:2.0:1786034739.252525:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9645412a9f80 x1872792636210432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786034739.252533:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636210432:0@lo:400:kworker.0 00010000:00080000:1.0:1786034739.253006:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9645412aaa00 x1872792636210176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786034764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786034739.253020:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1786034739.253027:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1786034739.253032:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1786034739.253035:0:3306:0:(import.c:65:import_set_state_nolock()) ffff964551259000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1786034739.253047:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1786034739.253052:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872792636210176:0@lo:8:kworker.0 00000004:00080000:1.0:1786034739.253071:0:14380:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1786034739.253504:0:14380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 575461679418ns, next at 0ns, rc = 0 00000004:00080000:2.0:1786034739.255963:0:14381:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1786034739.255987:0:14381:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14381:1872792636210816:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1786034739.256067:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636210688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034739.264900:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3307:x1872792636209920:12345-0@lo:400:kworker.0 Request processed in 13781us (16175us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034739.264913:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1786034739.265011:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3307:1872792636209920:0@lo:400:kworker.0 00000100:00100000:2.0:1786034739.269298:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034739.269337:0:14381:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558cda480 going to sleep for 11 seconds 00000100:00100000:1.0:1786034739.269446:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636210816 00000100:00100000:1.0:1786034739.269455:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636210816 00000100:00100000:1.0:1786034739.269504:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786034739.269513:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14381:x1872792636210816:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1786034739.272778:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786034739.274540:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034739.274796:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636210688 00000100:00100000:2.0:1786034739.274805:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636210688 00000100:00100000:2.0:1786034739.274868:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786034739.274877:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1872792636210688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034739.274908:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034739.274959:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1872792636210688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034739.274966:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1786034739.275771:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574df9180 x1872792636210688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786034755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034739.275791:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636210688:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1786034739.279096:0:15041:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1786034739.279105:0:15041:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1786034739.279110:0:15041:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1786034739.301841:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.301852:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b755282/0x490975051af40eb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.301867:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.301871:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.301877:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b755282/0x490975051af40eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.301904:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b755282/0x490975051af40eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.301914:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b755282/0x490975051af40eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.301921:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b755282/0x490975051af40eb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.301942:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786034739.303233:0:15267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034739.303241:0:15267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b755282/0x490975051af40eb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034739.303252:0:15267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724bc00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:3.0:1786034739.303257:0:15267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b755282/0x490975051af40eb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034739.303266:0:15267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b755282/0x490975051af40eb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034739.303284:0:15267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b755282/0x490975051af40eb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034739.303292:0:15267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b755282/0x490975051af40eb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034739.303310:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034739.303312:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034739.303314:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.306567:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.306579:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40ec0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.306593:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.306597:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.306602:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.306614:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.306725:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.306746:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309015:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034739.309030:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.309037:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309049:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a800 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.309054:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309064:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40ec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309083:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40ec0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309091:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40ec0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309108:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.309109:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.309111:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.309561:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.309574:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ec7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309584:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.309588:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.309593:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309604:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309612:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309619:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309633:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034739.309641:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.309645:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309652:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724ac00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.309655:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309663:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309681:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ec7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309688:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ec7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.309700:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.309701:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.309703:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.310076:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.310081:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ece lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.310089:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.310092:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.310096:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.310104:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.310111:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.310118:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.310141:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034739.310149:0:15267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.310153:0:15267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.310160:0:15267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724ba00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.310163:0:15267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.310171:0:15267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.310181:0:15267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ece lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.310188:0:15267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ece lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.310199:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.310201:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.310202:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.314329:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.314354:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.314363:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40ed5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.314388:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.314393:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.314398:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.314483:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.314495:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.314504:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.315495:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786034739.316019:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.316026:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40edc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.316038:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.316042:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.316047:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40edc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.316058:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40edc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.316079:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40edc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.316087:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40edc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034739.321490:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786034739.321503:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034739.321518:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a000 already unused, calling callback (ffffffffc1761020) 00010000:00010000:2.0:1786034739.321523:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034739.321536:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40ed5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034739.321559:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40ed5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034739.321568:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40ed5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034739.321588:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786034739.321592:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40edc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034739.321599:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:2.0:1786034739.321602:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40edc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034739.321632:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40edc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034739.321644:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40edc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034739.321652:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034739.321654:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034739.321656:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.326414:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786034739.326428:0:15041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40edc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786034739.327036:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.327044:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c707e6c1/0x490975051af40ee3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327058:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.327063:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.327069:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c707e6c1/0x490975051af40ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327081:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c707e6c1/0x490975051af40ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327090:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c707e6c1/0x490975051af40ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327120:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c707e6c1/0x490975051af40ee3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327135:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034739.327145:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.327150:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c707e6c1/0x490975051af40ee3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327158:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724be00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.327163:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c707e6c1/0x490975051af40ee3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327171:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c707e6c1/0x490975051af40ee3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327186:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c707e6c1/0x490975051af40ee3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327193:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c707e6c1/0x490975051af40ee3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327205:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.327207:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.327209:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.327583:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.327595:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40eea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327603:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.327606:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.327610:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40eea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327619:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40eea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327626:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40eea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327633:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40eea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327646:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034739.327654:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.327658:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40eea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327665:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724b200 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.327669:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40eea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327676:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40eea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327693:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40eea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327700:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40eea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.327712:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.327714:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.327715:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.328109:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.328115:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ef1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328123:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.328126:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.328130:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328138:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328146:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328153:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328174:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034739.328181:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.328185:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328192:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724ba00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.328195:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328203:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ef1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328214:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ef1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328221:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40ef1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328232:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.328234:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.328236:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.328592:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.328599:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ef8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328606:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.328614:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.328618:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328628:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328635:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328642:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328654:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034739.328661:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.328665:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328672:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724ac00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.328675:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328682:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ef8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328692:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ef8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328709:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40ef8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.328721:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.328722:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.328724:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.329087:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.329093:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40eff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.329100:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.329104:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.329107:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40eff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.329115:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40eff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.329122:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40eff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.329129:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40eff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.329141:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034739.329147:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.329156:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40eff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.329163:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a800 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.329166:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40eff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.329173:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40eff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.329183:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40eff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.329190:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40eff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.329201:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.329203:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.329204:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.333997:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.334010:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000372e6015/0x490975051af40f06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.334027:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.334031:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.334037:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000372e6015/0x490975051af40f06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.334061:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000372e6015/0x490975051af40f06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.334070:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000372e6015/0x490975051af40f06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.334078:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000372e6015/0x490975051af40f06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.334176:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786034739.334602:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.334608:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.334616:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.334619:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.334635:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.334646:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.334654:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.334673:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.335035:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786034739.335043:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000372e6015/0x490975051af40f06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.335057:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724b000 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034739.335063:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000372e6015/0x490975051af40f06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.335071:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000372e6015/0x490975051af40f06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.335088:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000372e6015/0x490975051af40f06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.335105:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000372e6015/0x490975051af40f06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.335122:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034739.335125:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.335131:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724b400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034739.335134:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.335141:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.335149:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.335161:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034739.335162:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034739.335164:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.335261:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786034739.335266:0:15041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786034739.336547:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.336555:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.336566:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.336569:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.336574:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.336584:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.336592:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.336611:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.336788:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034739.336797:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.336802:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.336809:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a600 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.336813:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.336839:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.336853:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.336860:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.336875:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.336876:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.336878:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034739.336963:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034739.337092:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.342883:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.342896:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40f1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.342912:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.342922:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.342927:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40f1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.342941:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40f1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.342950:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40f1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.342958:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40f1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.342974:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034739.342984:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.342990:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40f1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.342997:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.343001:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40f1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.343009:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40f1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.343024:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40f1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.343054:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af40f1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.343070:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.343072:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.343074:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.343583:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.343589:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b27bf09/0x490975051af40f22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.343597:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.343601:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.343605:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b27bf09/0x490975051af40f22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.343615:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b27bf09/0x490975051af40f22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.343630:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b27bf09/0x490975051af40f22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.343638:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b27bf09/0x490975051af40f22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.343651:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786034739.344010:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.344021:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092b0fdd5/0x490975051af40f29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344028:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.344031:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.344035:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b0fdd5/0x490975051af40f29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344044:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092b0fdd5/0x490975051af40f29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344051:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092b0fdd5/0x490975051af40f29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344058:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092b0fdd5/0x490975051af40f29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344070:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786034739.344078:0:15267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786034739.344083:0:15267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b27bf09/0x490975051af40f22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344090:0:15267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724aa00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.344094:0:15267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b27bf09/0x490975051af40f22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344101:0:15267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b27bf09/0x490975051af40f22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344116:0:15267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b27bf09/0x490975051af40f22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344124:0:15267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b27bf09/0x490975051af40f22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344136:0:15267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.344139:0:15267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092b0fdd5/0x490975051af40f29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344144:0:15267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724b600 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.344148:0:15267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092b0fdd5/0x490975051af40f29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344156:0:15267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092b0fdd5/0x490975051af40f29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344165:0:15267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092b0fdd5/0x490975051af40f29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344172:0:15267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092b0fdd5/0x490975051af40f29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344183:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.344185:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.344191:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.344577:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.344583:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344591:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.344595:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.344599:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344608:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344615:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344622:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344634:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034739.344641:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.344644:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344650:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724b800 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.344654:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344673:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344685:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344693:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.344705:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.344707:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.344709:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.345090:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.345096:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.345103:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.345106:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.345110:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.345119:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.345126:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.345138:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.345150:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034739.345157:0:15267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.345161:0:15267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.345168:0:15267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a000 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.345172:0:15267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.345180:0:15267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.345191:0:15267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.345199:0:15267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.345212:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.345214:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.345215:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034739.347804:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786034739.357303:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1786034739.358394:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.358423:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.358440:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.358446:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.358452:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.358467:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.358477:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.358486:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.358510:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786034739.358915:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034739.358923:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.358931:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a600 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034739.358935:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.358944:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.358961:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.358967:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084acedad/0x490975051af40f3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.358982:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034739.358983:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034739.358985:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.360122:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.360130:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.360139:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.360143:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.360148:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.360158:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.360172:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.360181:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.360199:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786034739.360594:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.360600:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40f4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.360609:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.360612:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.360617:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40f4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.360638:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40f4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.360646:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40f4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.360653:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40f4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.360677:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1786034739.361070:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.361076:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40f53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361085:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.361088:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.361093:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40f53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361102:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40f53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361111:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40f53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361118:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40f53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361131:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1786034739.361138:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786034739.361143:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361151:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724b400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.361160:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361169:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361182:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f45 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361189:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c81bfee1/0x490975051af40f45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361202:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786034739.361205:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40f4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361212:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a800 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.361215:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40f4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361222:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40f4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361231:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40f4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361239:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4d8c34f/0x490975051af40f4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361258:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.361261:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40f53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361268:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724ac00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.361272:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40f53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361279:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40f53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361289:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40f53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361295:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f3a3f26/0x490975051af40f53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361304:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.361305:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.361307:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.361671:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.361677:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40f5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361686:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.361689:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.361699:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40f5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361708:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40f5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361717:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40f5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361725:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40f5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361737:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034739.361744:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.361747:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40f5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361754:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724ba00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.361758:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40f5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361766:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40f5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361777:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40f5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361795:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b66752d/0x490975051af40f5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.361808:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.361809:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.361811:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.361857:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.362221:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.362227:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40f61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.362235:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.362238:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.362242:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40f61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.362251:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40f61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.362259:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40f61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.362266:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40f61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.362277:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786034739.362289:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034739.362293:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40f61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.362301:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724b200 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034739.362305:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40f61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.362313:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40f61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.362325:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40f61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.362333:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084420f68/0x490975051af40f61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.362345:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.362346:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034739.362348:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034739.364723:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.366903:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.366913:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.366929:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.366934:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.366940:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.366965:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.366975:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.366983:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.367006:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786034739.367330:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034739.367341:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.367349:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a000 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034739.367353:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.367361:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.367378:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f68 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.367385:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001298a8cd/0x490975051af40f68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034739.367400:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034739.367402:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034739.367415:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786034739.368065:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786034739.368071:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.368080:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1786034739.368083:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034739.368087:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1786034739.369034:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1786034739.369438:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.369453:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.369473:0:15041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034739.369496:0:15041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1786034739.369718:0:15041:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1786034739.369797:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14381:x1872792636210816:12345-0@lo:5:osp-pre-1-0.0 Request processed in 100282us (100501us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034739.369806:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786034739.369867:0:14381:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14381:1872792636210816:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1786034739.369880:0:14381:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1786034739.369916:0:14381:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14381:1872792636210944:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1786034739.369945:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034739.369977:0:14381:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d58300 going to sleep for 11 seconds 00000100:00100000:1.0:1786034739.369990:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636210944 00000100:00100000:1.0:1786034739.369995:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636210944 00000100:00100000:1.0:1786034739.370027:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786034739.370034:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14381:x1872792636210944:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1786034739.370064:0:15040:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1786034739.370819:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034739.370852:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034739.370863:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724b800 already unused, calling callback (ffffffffc1761020) 00010000:00010000:3.0:1786034739.370867:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034739.370876:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034739.370892:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034739.370899:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fee288c8/0x490975051af40f6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034739.370913:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034739.370915:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034739.370916:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034739.374930:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14381:x1872792636210944:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4890us (4978us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1786034739.374941:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786034739.375026:0:14381:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14381:1872792636210944:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1786034739.375040:0:14381:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1786034740.272008:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786034740.272027:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636211072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034740.272083:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034740.272137:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636211072 00000100:00100000:1.0:1786034740.272143:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636211072 00000100:00100000:1.0:1786034740.272185:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786034740.272206:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636211072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786034740.272240:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034740.272293:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636211072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034740.272301:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786034740.272346:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636211072:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786034740.342970:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034741.365369:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034742.384601:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034743.412078:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786034743.999361:0:16120:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1786034744.380623:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3307:1872792636211200:0@lo:400:kworker.0 00000100:00100000:0.0:1786034744.380689:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034744.380733:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636211712:0@lo:400:kworker.0 00000100:00100000:0.0:1786034744.380759:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034744.380783:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786034744.380789:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636211328:0@lo:400:kworker.0 00000100:00100000:0.0:1786034744.380810:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034744.380849:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636211840:0@lo:400:kworker.0 00000100:00100000:0.0:1786034744.380872:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034744.380897:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636211456:0@lo:400:kworker.0 00000100:00100000:0.0:1786034744.380927:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034744.380944:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034744.380949:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636211584:0@lo:400:kworker.0 00000100:00100000:0.0:1786034744.380969:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034744.380996:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636211712 00000100:00100000:0.0:1786034744.381002:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636211712 00000100:00100000:0.0:1786034744.381041:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636211840 00000100:00100000:0.0:1786034744.381043:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636211840 00000100:00100000:0.0:1786034744.381054:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636211584 00000100:00100000:0.0:1786034744.381056:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636211584 00000100:00100000:0.0:1786034744.381069:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1786034744.381077:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636211712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034744.381124:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636211712:12345-0@lo:400:kworker.0 Request processed in 47us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034744.381131:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1786034744.381147:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786034744.381153:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636211840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034744.381176:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636211840:12345-0@lo:400:kworker.0 Request processed in 24us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034744.381181:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786034744.381189:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786034744.381194:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636211584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034744.381217:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636211584:12345-0@lo:400:kworker.0 Request processed in 23us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034744.381230:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786034744.381246:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636211328 00000100:00100000:0.0:1786034744.381249:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636211328 00000100:00100000:0.0:1786034744.381269:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636211456 00000100:00100000:0.0:1786034744.381271:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636211456 00000100:00100000:0.0:1786034744.381285:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786034744.381290:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636211328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034744.381316:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636211328:12345-0@lo:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034744.381320:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786034744.381329:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786034744.381334:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636211456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034744.381352:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636211456:12345-0@lo:400:kworker.0 Request processed in 18us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034744.381356:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1786034744.381386:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786034744.381390:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786034744.381392:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786034744.381416:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9644476c0700 x1872792636211584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034744.381428:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636211584:0@lo:400:kworker.0 00000100:00100000:0.0:1786034744.381437:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636211456:0@lo:400:kworker.0 00000100:00100000:0.0:1786034744.381459:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636211328:0@lo:400:kworker.0 00010000:00080000:0.0:1786034744.381466:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964574df9180 x1872792636211840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034744.381486:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636211840:0@lo:400:kworker.0 00010000:00080000:0.0:1786034744.381498:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9644476c0000 x1872792636211712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786034760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786034744.381505:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636211712:0@lo:400:kworker.0 00000100:00100000:2.0:1786034744.383164:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636211200 00000100:00100000:2.0:1786034744.383171:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636211200 00000100:00100000:2.0:1786034744.383202:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1786034744.383208:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3307:x1872792636211200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034744.383254:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3307:x1872792636211200:12345-0@lo:400:kworker.0 Request processed in 46us (2566us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034744.383259:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1786034744.392318:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786034744.392343:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636211968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034744.392418:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034744.392492:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636211968 00000100:00100000:0.0:1786034744.392500:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636211968 00000100:00100000:0.0:1786034744.392541:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786034744.392548:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1872792636211968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786034744.392576:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034744.392619:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1872792636211968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034744.392626:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786034744.409795:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636211968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034744.409956:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3307:1872792636211200:0@lo:400:kworker.0 00010000:00010000:0.0:1786034744.460844:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786034744.599240:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:2.0:1786034745.391964:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636212096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034745.392025:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034745.393893:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636212096 00000100:00100000:3.0:1786034745.393903:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636212096 00000100:00100000:3.0:1786034745.393954:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786034745.393964:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636212096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786034745.393998:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034745.402493:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636212096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8523us (10459us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034745.402518:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786034745.410735:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636212096:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786034745.519940:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034746.543958:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786034747.008023:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1786034747.260900:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034747.261302:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608944512 00000100:00100000:1.0:1786034747.261312:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608944512 00000100:00100000:1.0:1786034747.261367:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 78 00000100:00100000:1.0:1786034747.261590:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2361:x1872792608944512:12345-192.168.203.56@tcp:250:mount.lustre.0 00010000:00080000:1.0:1786034747.261620:0:14350:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 9aa3392f-5dd2-4b3f-9ee0-d03730485c08@192.168.203.56@tcp t0 exp 0000000000000000 cur 583 last 0 00000020:00000080:1.0:1786034747.261783:0:14350:0:(genops.c:1406:class_connect()) connect: client 9aa3392f-5dd2-4b3f-9ee0-d03730485c08, cookie 0x490975051af40f76 00000100:00080000:1.0:1786034747.261923:0:14350:0:(import.c:65:import_set_state_nolock()) ffff964445eff000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786034747.261986:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+5:2361:x1872792608944512:12345-192.168.203.56@tcp:250:mount.lustre.0 Request processed in 610us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034747.261994:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 78 00000100:00100000:3.0:1786034747.290407:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034747.290506:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608944640 00000100:00100000:0.0:1786034747.290515:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608944640 00000100:00100000:0.0:1786034747.290569:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 79 00000100:00100000:0.0:1786034747.290579:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96454a067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+5:13760:x1872792608944640:12345-192.168.203.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786034747.290611:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034747.290628:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df9e00/0x490975051af40f7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7589d8 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034747.290655:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df9e00/0x490975051af40f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589d8 expref: 6 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034747.290666:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df9e00/0x490975051af40f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589d8 expref: 6 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034747.290674:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9e00, rc 0) 00000100:00100000:0.0:1786034747.290729:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96454a067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+6:13760:x1872792608944640:12345-192.168.203.56@tcp:101:mount.lustre.0 Request processed in 151us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034747.290735:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 79 00000100:00100000:0.0:1786034747.304911:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034747.305015:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608944768 00000100:00100000:2.0:1786034747.305025:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608944768 00000100:00100000:2.0:1786034747.305070:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 80 00000100:00100000:2.0:1786034747.305086:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964445331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+6:13760:x1872792608944768:12345-192.168.203.56@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786034747.305357:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964445331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+6:13760:x1872792608944768:12345-192.168.203.56@tcp:501:mount.lustre.0 Request processed in 270us (444us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786034747.305365:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 80 00000100:00100000:3.0:1786034747.313975:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034747.314069:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608944896 00000100:00100000:1.0:1786034747.314086:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608944896 00000100:00100000:1.0:1786034747.314154:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 81 00000100:00100000:1.0:1786034747.314163:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964445332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+6:13760:x1872792608944896:12345-192.168.203.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1786034747.314180:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034747.314198:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96444724bc00/0x490975051af40f84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b7589df expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034747.314223:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96444724bc00/0x490975051af40f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589df expref: 7 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034747.314235:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96444724bc00/0x490975051af40f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b7589df expref: 7 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034747.314243:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724bc00, rc 0) 00000100:00100000:1.0:1786034747.314300:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964445332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+7:13760:x1872792608944896:12345-192.168.203.56@tcp:101:mount.lustre.0 Request processed in 138us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034747.314308:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 81 00000100:00100000:3.0:1786034747.318866:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034747.318982:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608945024 00000100:00100000:2.0:1786034747.318992:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608945024 00000100:00100000:2.0:1786034747.319047:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 82 00000100:00100000:2.0:1786034747.319056:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964445330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+7:13760:x1872792608945024:12345-192.168.203.56@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786034747.319324:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964445330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+8:13760:x1872792608945024:12345-192.168.203.56@tcp:501:mount.lustre.0 Request processed in 268us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034747.319332:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 82 00000100:00100000:2.0:1786034747.323767:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034747.333503:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608945152 00000100:00100000:0.0:1786034747.333518:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608945152 00000100:00100000:0.0:1786034747.333699:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 83 00000100:00100000:0.0:1786034747.333711:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+8:13760:x1872792608945152:12345-192.168.203.56@tcp:503:mount.lustre.0 00000100:00100000:0.0:1786034747.334159:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+8:13760:x1872792608945152:12345-192.168.203.56@tcp:503:mount.lustre.0 Request processed in 449us (10400us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034747.334168:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 83 00000100:00100000:3.0:1786034747.347663:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034747.347932:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608945280 00000100:00100000:1.0:1786034747.347940:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608945280 00000100:00100000:1.0:1786034747.347995:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 84 00000100:00100000:1.0:1786034747.348005:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+8:13780:x1872792608945280:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786034747.348382:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+8:13780:x1872792608945280:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 370us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034747.348392:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 84 00000100:00100000:3.0:1786034747.395482:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034747.395613:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608945408 00000100:00100000:1.0:1786034747.395622:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608945408 00000100:00100000:1.0:1786034747.395673:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 85 00000100:00100000:1.0:1786034747.395683:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+8:13780:x1872792608945408:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786034747.395975:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+8:13780:x1872792608945408:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 293us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034747.395983:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 85 00000100:00100000:3.0:1786034747.405953:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034747.406242:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608945536 00000100:00100000:2.0:1786034747.406251:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608945536 00000100:00100000:2.0:1786034747.406309:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 86 00000100:00100000:2.0:1786034747.406318:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+8:13760:x1872792608945536:12345-192.168.203.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786034747.406332:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034747.406359:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964548aa6200/0x490975051af40f8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758a09 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034747.406389:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964548aa6200/0x490975051af40f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a09 expref: 9 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034747.406400:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964548aa6200/0x490975051af40f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a09 expref: 9 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034747.406422:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6200, rc 0) 00000100:00100000:2.0:1786034747.406476:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+9:13760:x1872792608945536:12345-192.168.203.56@tcp:101:mount.lustre.0 Request processed in 159us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034747.406482:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 86 00000100:00100000:3.0:1786034747.424696:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034747.424786:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608945664 00000100:00100000:1.0:1786034747.424795:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608945664 00000100:00100000:1.0:1786034747.424878:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 87 00000100:00100000:1.0:1786034747.424887:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+9:13760:x1872792608945664:12345-192.168.203.56@tcp:256:mount.lustre.0 20000000:01000000:1.0:1786034747.424911:0:14350:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1786034747.424935:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1786034747.424939:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1786034747.424943:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1786034747.424945:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1786034747.427684:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+9:13760:x1872792608945664:12345-192.168.203.56@tcp:256:mount.lustre.0 Request processed in 2788us (2986us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034747.427698:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 87 00000100:00100000:2.0:1786034747.457652:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034747.457784:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608945792 00000100:00100000:0.0:1786034747.457793:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608945792 00000100:00100000:0.0:1786034747.457893:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 88 00000100:00100000:0.0:1786034747.457903:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+9:13760:x1872792608945792:12345-192.168.203.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786034747.457918:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034747.457947:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df8200/0x490975051af40f92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758a10 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034747.457977:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df8200/0x490975051af40f92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a10 expref: 10 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034747.457989:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df8200/0x490975051af40f92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a10 expref: 10 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034747.457998:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8200, rc 0) 00000100:00100000:0.0:1786034747.458047:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+10:13760:x1872792608945792:12345-192.168.203.56@tcp:101:mount.lustre.0 Request processed in 146us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034747.458054:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 88 00000100:00100000:3.0:1786034747.465654:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034747.465921:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608945920 00000100:00100000:1.0:1786034747.465931:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608945920 00000100:00100000:1.0:1786034747.465982:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 89 00000100:00100000:1.0:1786034747.465990:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+10:13760:x1872792608945920:12345-192.168.203.56@tcp:501:mount.lustre.0 00000100:00100000:1.0:1786034747.466273:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+10:13760:x1872792608945920:12345-192.168.203.56@tcp:501:mount.lustre.0 Request processed in 282us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034747.466280:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 89 00000100:00100000:1.0:1786034747.472483:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034747.472568:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608946048 00000100:00100000:3.0:1786034747.472586:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608946048 00000100:00100000:3.0:1786034747.472639:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 90 00000100:00100000:3.0:1786034747.472649:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+10:13760:x1872792608946048:12345-192.168.203.56@tcp:503:mount.lustre.0 00000100:00100000:3.0:1786034747.473127:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+10:13760:x1872792608946048:12345-192.168.203.56@tcp:503:mount.lustre.0 Request processed in 477us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034747.473137:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 90 00000100:00100000:2.0:1786034747.478061:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034747.478439:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608946176 00000100:00100000:0.0:1786034747.478449:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608946176 00000100:00100000:0.0:1786034747.478501:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 91 00000100:00100000:0.0:1786034747.478512:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+10:13784:x1872792608946176:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786034747.478779:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+10:13784:x1872792608946176:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 268us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034747.478786:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 91 00000100:00100000:0.0:1786034747.488469:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034747.488669:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608946304 00000100:00100000:1.0:1786034747.488679:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608946304 00000100:00100000:1.0:1786034747.488732:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 92 00000100:00100000:1.0:1786034747.488755:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+10:13784:x1872792608946304:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786034747.489029:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+10:13784:x1872792608946304:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 275us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034747.489048:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 92 00000100:00100000:3.0:1786034747.500428:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034747.500566:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608946432 00000100:00100000:0.0:1786034747.500580:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608946432 00000100:00100000:0.0:1786034747.500624:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 4 00000100:00100000:0.0:1786034747.500631:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2361:x1872792608946432:12345-192.168.203.56@tcp:38:mount.lustre.0 00010000:00080000:0.0:1786034747.500659:0:14357:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 5dad3ced-da50-4764-ac1e-c77a2e771b85@192.168.203.56@tcp t0 exp 0000000000000000 cur 583 last 0 00000020:00000080:0.0:1786034747.500705:0:14357:0:(genops.c:1406:class_connect()) connect: client 5dad3ced-da50-4764-ac1e-c77a2e771b85, cookie 0x490975051af40f99 00000004:00100000:0.0:1786034747.500742:0:14357:0:(mdt_handler.c:7328:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1786034747.500747:0:14357:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1786034747.569056:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786034747.622179:0:14357:0:(import.c:65:import_set_state_nolock()) ffff964447bc2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786034747.622253:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:2361:x1872792608946432:12345-192.168.203.56@tcp:38:mount.lustre.0 Request processed in 121620us (121832us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034747.622264:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 4 00000100:00100000:2.0:1786034747.627335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034747.627379:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034747.627459:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608946688 00000100:00100000:0.0:1786034747.627469:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608946688 00000100:00100000:0.0:1786034747.627545:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608946560 00000100:00100000:0.0:1786034747.627548:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608946560 00000100:00100000:0.0:1786034747.627565:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 5 00000100:00100000:0.0:1786034747.627573:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:13760:x1872792608946688:12345-192.168.203.56@tcp:41:mount.lustre.0 00000004:00000024:0.0:1786034747.627613:0:14356:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1786034747.627690:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:13760:x1872792608946688:12345-192.168.203.56@tcp:41:mount.lustre.0 Request processed in 117us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034747.627698:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 5 00000100:00100000:0.0:1786034747.627715:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 6 00000100:00080000:2.0:1786034747.628264:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034747.628326:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:0:x1872792608946560:12345-192.168.203.56@tcp:41:mount.lustre.0 00000004:00000024:0.0:1786034747.628341:0:14356:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1786034747.628386:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:0:x1872792608946560:12345-192.168.203.56@tcp:41:mount.lustre.0 Request processed in 664us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034747.628393:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 6 00000100:00100000:0.0:1786034747.630373:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034747.630461:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608946816 00000100:00100000:3.0:1786034747.630470:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608946816 00000100:00100000:3.0:1786034747.630514:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 7 00000100:00100000:3.0:1786034747.630522:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:13760:x1872792608946816:12345-192.168.203.56@tcp:40:mount.lustre.0 00000100:00100000:3.0:1786034747.630592:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:13760:x1872792608946816:12345-192.168.203.56@tcp:40:mount.lustre.0 Request processed in 70us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034747.630614:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 7 00000100:00100000:0.0:1786034747.634418:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034747.634558:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608947200 00000100:00100000:1.0:1786034747.634567:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608947200 00000100:00100000:1.0:1786034747.634616:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:1.0:1786034747.634626:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:13760:x1872792608947200:12345-192.168.203.56@tcp:33:mount.lustre.0 00000004:00080000:0.0:1786034747.635387:0:14359:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 701us 00000100:00100000:0.0:1786034747.637336:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034747.637385:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034747.637400:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608946944 00000100:00100000:2.0:1786034747.637410:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608946944 00000100:00100000:2.0:1786034747.637452:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608947072 00000100:00100000:2.0:1786034747.637455:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608947072 00000100:00100000:2.0:1786034747.637479:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:2.0:1786034747.637486:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1872792608946944:12345-192.168.203.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1786034747.637513:0:15039:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 5dad3ced-da50-4764-ac1e-c77a2e771b85@192.168.203.56@tcp t0 exp 0000000000000000 cur 583 last 0 00000020:00000080:2.0:1786034747.637549:0:15039:0:(genops.c:1406:class_connect()) connect: client 5dad3ced-da50-4764-ac1e-c77a2e771b85, cookie 0x490975051af40fa0 00002000:00100000:2.0:1786034747.637561:0:15039:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5dad3ced-da50-4764-ac1e-c77a2e771b85/ffff964447bc2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113834 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786034747.637582:0:15039:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1786034747.637685:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00100000:3.0:1786034747.637692:0:15468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1872792608947072:12345-192.168.203.56@tcp:8:mount.lustre.0 00010000:00080000:3.0:1786034747.637710:0:15468:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 5dad3ced-da50-4764-ac1e-c77a2e771b85@192.168.203.56@tcp t0 exp 0000000000000000 cur 583 last 0 00000020:00000080:3.0:1786034747.637731:0:15468:0:(genops.c:1406:class_connect()) connect: client 5dad3ced-da50-4764-ac1e-c77a2e771b85, cookie 0x490975051af40fa7 00002000:00100000:3.0:1786034747.637738:0:15468:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5dad3ced-da50-4764-ac1e-c77a2e771b85/ffff9644452e4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113834 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786034747.637754:0:15468:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786034747.637995:0:15468:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1786034747.638020:0:15468:0:(import.c:65:import_set_state_nolock()) ffff9644452e6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786034747.638077:0:15468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:2361:x1872792608947072:12345-192.168.203.56@tcp:8:mount.lustre.0 Request processed in 383us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034747.638084:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 11 00002000:00080000:2.0:1786034747.638657:0:15039:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786034747.638675:0:15039:0:(import.c:65:import_set_state_nolock()) ffff964447bc7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786034747.639296:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:2361:x1872792608946944:12345-192.168.203.56@tcp:8:mount.lustre.0 Request processed in 1807us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034747.639306:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 10 00000004:00200000:3.0:1786034747.664756:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1786034747.664951:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:13760:x1872792608947200:12345-192.168.203.56@tcp:33:mount.lustre.0 Request processed in 30322us (30537us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034747.664965:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:3.0:1786034747.859558:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034747.859783:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608947328 00000100:00100000:0.0:1786034747.859792:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608947328 00000100:00100000:0.0:1786034747.859883:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 8 00000100:00100000:0.0:1786034747.859906:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:13805:x1872792608947328:12345-192.168.203.56@tcp:101:mkdir.0 00010000:00010000:0.0:1786034747.859926:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034747.859949:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40fae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758a3a expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034747.860006:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af40fb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034747.860032:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af40fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034747.860051:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af40fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034747.860398:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1786034747.860403:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034747.860498:0:14358:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af40fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034747.860525:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8c00/0x490975051af40fae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a3a expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034747.860542:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af40fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a3a expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034747.860550:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9645821d2c00) 00010000:00010000:0.0:1786034747.860553:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034747.860556:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9000, rc 0) 00000100:00100000:0.0:1786034747.860659:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:13805:x1872792608947328:12345-192.168.203.56@tcp:101:mkdir.0 Request processed in 754us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034747.860676:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 8 00000001:00100000:1.0:1786034748.541048:0:6746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5dad3ced-da50-4764-ac1e-c77a2e771b85 00010000:00010000:2.0:1786034748.591940:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034749.488005:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636212224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034749.488090:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034749.488144:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636212224 00000100:00100000:1.0:1786034749.488152:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636212224 00000100:00080000:2.0:1786034749.488185:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786034749.488204:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786034749.488213:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636212224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786034749.488245:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786034749.488299:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636212224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034749.488306:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786034749.488498:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1786034749.488521:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636212224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034749.501428:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3308:1872792636212352:0@lo:400:kworker.0 00000100:00100000:0.0:1786034749.501492:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034749.501523:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636212864:0@lo:400:kworker.0 00000100:00100000:0.0:1786034749.501545:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034749.501567:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786034749.501572:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636212736:0@lo:400:kworker.0 00000100:00100000:0.0:1786034749.501593:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034749.501627:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636212480:0@lo:400:kworker.0 00000100:00100000:0.0:1786034749.501651:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034749.501668:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034749.501672:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636212608:0@lo:400:kworker.0 00000100:00100000:0.0:1786034749.501689:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034749.501711:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636212864 00000100:00100000:0.0:1786034749.501717:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636212864 00000100:00100000:0.0:1786034749.501755:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636212736 00000100:00100000:0.0:1786034749.501757:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636212736 00000100:00100000:0.0:1786034749.501767:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636212608 00000100:00100000:0.0:1786034749.501769:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636212608 00000100:00100000:0.0:1786034749.501781:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786034749.501787:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636212864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034749.501858:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636212864:12345-0@lo:400:kworker.0 Request processed in 69us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034749.501865:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786034749.501881:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786034749.501886:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636212736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034749.501927:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636212736:12345-0@lo:400:kworker.0 Request processed in 41us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034749.501933:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786034749.501944:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786034749.501950:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636212608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034749.501971:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636212608:12345-0@lo:400:kworker.0 Request processed in 22us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034749.501977:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786034749.502009:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636212736:0@lo:400:kworker.0 00000100:00100000:0.0:1786034749.502029:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636212864:0@lo:400:kworker.0 00000100:00100000:0.0:1786034749.502058:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636212608:0@lo:400:kworker.0 00000100:00080000:0.0:1786034749.502072:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034749.502239:0:15468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636212480 00000100:00100000:0.0:1786034749.502245:0:15468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636212480 00000100:00100000:0.0:1786034749.502278:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786034749.502284:0:15468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636212480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034749.502319:0:15468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636212480:12345-0@lo:400:kworker.0 Request processed in 35us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034749.502325:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786034749.502410:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636212480:0@lo:400:kworker.0 00000100:00080000:0.0:1786034749.502424:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786034749.502496:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636212352 00000100:00100000:1.0:1786034749.502500:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636212352 00000100:00100000:1.0:1786034749.502533:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1786034749.502539:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3308:x1872792636212352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034749.502572:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3308:x1872792636212352:12345-0@lo:400:kworker.0 Request processed in 33us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034749.502578:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1786034749.507635:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3308:1872792636212352:0@lo:400:kworker.0 00000001:00100000:2.0:1786034749.595645:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5dad3ced-da50-4764-ac1e-c77a2e771b85 00010000:00010000:2.0:1786034749.616159:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034750.512109:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636212992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786034750.512188:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034750.512316:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636212992 00000100:00100000:3.0:1786034750.512332:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636212992 00000100:00100000:3.0:1786034750.512379:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786034750.512388:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636212992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786034750.512419:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034750.512476:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636212992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034750.512493:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1786034750.512629:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636212992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786034750.640770:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034750.842475:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034750.842565:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608947456 00000100:00100000:2.0:1786034750.842573:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608947456 00000100:00100000:2.0:1786034750.842655:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00100000:2.0:1786034750.842666:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:13858:x1872792608947456:12345-192.168.203.56@tcp:41:lfs.0 00000004:00000024:2.0:1786034750.842708:0:14357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786034750.842796:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:13858:x1872792608947456:12345-192.168.203.56@tcp:41:lfs.0 Request processed in 132us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034750.842804:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00080000:0.0:1786034750.842886:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034750.856810:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034750.857359:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608947584 00000100:00100000:3.0:1786034750.857369:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608947584 00000100:00100000:3.0:1786034750.857441:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:3.0:1786034750.857451:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:13858:x1872792608947584:12345-192.168.203.56@tcp:13:lfs.0 00002000:00000024:3.0:1786034750.857475:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786034750.857552:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:13858:x1872792608947584:12345-192.168.203.56@tcp:13:lfs.0 Request processed in 103us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034750.857560:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00080000:0.0:1786034750.857652:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786034750.859791:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034750.864138:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608947712 00000100:00100000:2.0:1786034750.864151:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608947712 00000100:00100000:2.0:1786034750.864309:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00100000:2.0:1786034750.864321:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:13858:x1872792608947712:12345-192.168.203.56@tcp:13:lfs.0 00002000:00000024:2.0:1786034750.864379:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034750.864478:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:13858:x1872792608947712:12345-192.168.203.56@tcp:13:lfs.0 Request processed in 159us (4692us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034750.864502:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00080000:0.0:1786034750.869697:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786034751.174389:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034751.174487:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608947840 00000100:00100000:0.0:1786034751.174497:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608947840 00000100:00100000:0.0:1786034751.174568:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 94 00000100:00100000:0.0:1786034751.174578:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+10:13891:x1872792608947840:12345-192.168.203.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786034751.174594:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034751.174611:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df8c00/0x490975051af40fbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758a41 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034751.174648:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df8c00/0x490975051af40fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a41 expref: 11 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034751.174660:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df8c00/0x490975051af40fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a41 expref: 11 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034751.174668:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8c00, rc 0) 00000100:00100000:0.0:1786034751.174725:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+11:13891:x1872792608947840:12345-192.168.203.56@tcp:101:mount.lustre.0 Request processed in 149us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034751.174732:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 94 00000100:00100000:3.0:1786034751.180275:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034751.180609:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608947968 00000100:00100000:0.0:1786034751.180618:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608947968 00000100:00100000:0.0:1786034751.180723:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 95 00000100:00100000:0.0:1786034751.180734:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c12a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+11:13891:x1872792608947968:12345-192.168.203.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1786034751.181063:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c12a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+11:13891:x1872792608947968:12345-192.168.203.56@tcp:501:mount.lustre.0 Request processed in 330us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034751.181071:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 95 00000100:00100000:3.0:1786034751.183910:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034751.190621:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608948096 00000100:00100000:2.0:1786034751.190635:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608948096 00000100:00100000:0.0:1786034751.190770:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 96 00000100:00100000:0.0:1786034751.190784:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457c128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+11:13891:x1872792608948096:12345-192.168.203.56@tcp:503:mount.lustre.0 00000100:00100000:0.0:1786034751.193093:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457c128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+11:13891:x1872792608948096:12345-192.168.203.56@tcp:503:mount.lustre.0 Request processed in 2306us (9183us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034751.193104:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 96 00000100:00100000:1.0:1786034751.201377:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034751.201658:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608948224 00000100:00100000:0.0:1786034751.201669:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608948224 00000100:00100000:0.0:1786034751.201720:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 97 00000100:00100000:0.0:1786034751.201730:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+11:13897:x1872792608948224:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786034751.202327:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+11:13897:x1872792608948224:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 590us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034751.202337:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 97 00000100:00100000:1.0:1786034751.221090:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034751.221203:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608948352 00000100:00100000:2.0:1786034751.221211:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608948352 00000100:00100000:2.0:1786034751.221262:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 98 00000100:00100000:2.0:1786034751.221271:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+11:13897:x1872792608948352:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786034751.221781:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+11:13897:x1872792608948352:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 510us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034751.221790:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 98 00000100:00100000:3.0:1786034751.228010:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034751.228233:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608948480 00000100:00100000:0.0:1786034751.228242:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608948480 00000100:00100000:0.0:1786034751.228295:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 99 00000100:00100000:0.0:1786034751.228306:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+11:13891:x1872792608948480:12345-192.168.203.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786034751.228334:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034751.228351:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df8000/0x490975051af40fc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758a6b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034751.228379:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df8000/0x490975051af40fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a6b expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034751.228409:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df8000/0x490975051af40fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a6b expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034751.228418:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8000, rc 0) 00000100:00100000:0.0:1786034751.228472:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+12:13891:x1872792608948480:12345-192.168.203.56@tcp:101:mount.lustre.0 Request processed in 168us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034751.228479:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 99 00000100:00100000:1.0:1786034751.242720:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034751.245663:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608948608 00000100:00100000:2.0:1786034751.245674:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608948608 00000100:00100000:2.0:1786034751.245735:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 100 00000100:00100000:2.0:1786034751.245744:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+12:13891:x1872792608948608:12345-192.168.203.56@tcp:256:mount.lustre.0 20000000:01000000:2.0:1786034751.245767:0:14348:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1786034751.245794:0:14348:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1786034751.245798:0:14348:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1786034751.245801:0:14348:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1786034751.245804:0:14348:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1786034751.247341:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+12:13891:x1872792608948608:12345-192.168.203.56@tcp:256:mount.lustre.0 Request processed in 1592us (4623us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034751.247351:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 100 00000100:00100000:3.0:1786034751.251305:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034751.251395:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608948736 00000100:00100000:1.0:1786034751.251404:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608948736 00000100:00100000:1.0:1786034751.251454:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 101 00000100:00100000:1.0:1786034751.251463:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+12:13891:x1872792608948736:12345-192.168.203.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1786034751.251480:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034751.251498:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96444724ac00/0x490975051af40fca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758a72 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034751.251524:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96444724ac00/0x490975051af40fca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a72 expref: 13 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034751.251535:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96444724ac00/0x490975051af40fca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a72 expref: 13 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034751.251554:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724ac00, rc 0) 00000100:00100000:1.0:1786034751.251610:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:13891:x1872792608948736:12345-192.168.203.56@tcp:101:mount.lustre.0 Request processed in 148us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034751.251617:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 101 00000100:00100000:0.0:1786034751.256646:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034751.256753:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608948864 00000100:00100000:2.0:1786034751.256763:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608948864 00000100:00100000:2.0:1786034751.256874:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 102 00000100:00100000:2.0:1786034751.256885:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:13891:x1872792608948864:12345-192.168.203.56@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786034751.258048:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:13891:x1872792608948864:12345-192.168.203.56@tcp:501:mount.lustre.0 Request processed in 1163us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034751.258058:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 102 00000100:00100000:3.0:1786034751.267681:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034751.272092:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608948992 00000100:00100000:0.0:1786034751.272106:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608948992 00000100:00100000:0.0:1786034751.272355:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 103 00000100:00100000:0.0:1786034751.272365:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:13891:x1872792608948992:12345-192.168.203.56@tcp:503:mount.lustre.0 00000100:00100000:0.0:1786034751.274632:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:13891:x1872792608948992:12345-192.168.203.56@tcp:503:mount.lustre.0 Request processed in 2262us (6953us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034751.274644:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 103 00000100:00100000:3.0:1786034751.291433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034751.291918:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608949120 00000100:00100000:2.0:1786034751.291927:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608949120 00000100:00100000:2.0:1786034751.292377:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 104 00000100:00100000:2.0:1786034751.292388:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96455a52fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:13900:x1872792608949120:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786034751.292667:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96455a52fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:13900:x1872792608949120:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 281us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034751.292676:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 104 00000100:00100000:3.0:1786034751.301090:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034751.302328:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608949248 00000100:00100000:0.0:1786034751.302339:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608949248 00000100:00100000:0.0:1786034751.302399:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 105 00000100:00100000:0.0:1786034751.302409:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:13900:x1872792608949248:12345-192.168.203.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786034751.302694:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:13900:x1872792608949248:12345-192.168.203.56@tcp:502:llog_process_th.0 Request processed in 285us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034751.302703:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 105 00000100:00100000:3.0:1786034751.328683:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034751.328720:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034751.328859:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034751.329282:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608949504 00000100:00100000:0.0:1786034751.329292:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608949504 00000100:00100000:0.0:1786034751.329360:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:0.0:1786034751.329386:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:2362:x1872792608949504:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034751.329460:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:2362:x1872792608949504:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 76us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034751.329478:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:1.0:1786034751.340482:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608949760 00000100:00100000:1.0:1786034751.340496:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608949760 00000100:00100000:3.0:1786034751.342404:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034751.342890:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608949632 00000100:00100000:1.0:1786034751.342896:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608949632 00000100:00100000:1.0:1786034751.342917:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 6 00000100:00100000:1.0:1786034751.342925:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2362:x1872792608949760:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034751.343138:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2362:x1872792608949760:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 212us (14416us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034751.343294:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 6 00000100:00100000:1.0:1786034751.343311:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 7 00000100:00100000:1.0:1786034751.343318:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2362:x1872792608949632:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034751.343355:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2362:x1872792608949632:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 39us (14497us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034751.343361:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 7 00000100:00100000:0.0:1786034751.343856:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608949376 00000100:00100000:0.0:1786034751.343861:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608949376 00000100:00100000:0.0:1786034751.343886:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:0.0:1786034751.343891:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2361:x1872792608949376:12345-192.168.203.56@tcp:38:mount.lustre.0 00010000:00080000:0.0:1786034751.343912:0:14358:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from edfa1456-b35c-4b5b-9356-fefb374c3cea@192.168.203.56@tcp t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:0.0:1786034751.343957:0:14358:0:(genops.c:1406:class_connect()) connect: client edfa1456-b35c-4b5b-9356-fefb374c3cea, cookie 0x490975051af40fd1 00000004:00100000:0.0:1786034751.343985:0:14358:0:(mdt_handler.c:7328:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1786034751.344099:0:14358:0:(import.c:65:import_set_state_nolock()) ffff964447919000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786034751.344133:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:2361:x1872792608949376:12345-192.168.203.56@tcp:38:mount.lustre.0 Request processed in 240us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034751.344140:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:0.0:1786034751.357025:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034751.357061:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034751.357189:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608949888 00000100:00100000:2.0:1786034751.357198:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608949888 00000100:00100000:2.0:1786034751.357258:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608950016 00000100:00100000:2.0:1786034751.357261:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608950016 00000100:00100000:2.0:1786034751.357277:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00100000:2.0:1786034751.357285:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+7:0:x1872792608949888:12345-192.168.203.56@tcp:41:mount.lustre.0 00000004:00000024:2.0:1786034751.357314:0:14357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786034751.357389:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+7:0:x1872792608949888:12345-192.168.203.56@tcp:41:mount.lustre.0 Request processed in 104us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034751.357397:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00100000:2.0:1786034751.357413:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:2.0:1786034751.357419:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:13891:x1872792608950016:12345-192.168.203.56@tcp:41:mount.lustre.0 00000004:00000024:2.0:1786034751.357430:0:14357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786034751.357452:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:13891:x1872792608950016:12345-192.168.203.56@tcp:41:mount.lustre.0 Request processed in 33us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034751.357485:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00080000:0.0:1786034751.358372:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034751.362672:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034751.362755:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608950144 00000100:00100000:2.0:1786034751.362773:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608950144 00000100:00100000:2.0:1786034751.362851:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 13 00000100:00100000:2.0:1786034751.362860:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:13891:x1872792608950144:12345-192.168.203.56@tcp:40:mount.lustre.0 00000100:00100000:2.0:1786034751.363385:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:13891:x1872792608950144:12345-192.168.203.56@tcp:40:mount.lustre.0 Request processed in 72us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034751.363394:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 13 00000100:00100000:3.0:1786034751.366381:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034751.366422:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034751.366455:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034751.366642:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608950528 00000100:00100000:1.0:1786034751.366651:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608950528 00000100:00100000:1.0:1786034751.366695:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 1 00000100:00100000:1.0:1786034751.366704:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:13891:x1872792608950528:12345-192.168.203.56@tcp:33:mount.lustre.0 00000004:00200000:1.0:1786034751.367119:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1786034751.367305:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608950272 00000100:00100000:2.0:1786034751.367310:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608950272 00000100:00100000:2.0:1786034751.367341:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608950400 00000100:00100000:2.0:1786034751.367344:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608950400 00000100:00100000:2.0:1786034751.367360:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:2.0:1786034751.367366:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1872792608950272:12345-192.168.203.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1786034751.367388:0:15041:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from edfa1456-b35c-4b5b-9356-fefb374c3cea@192.168.203.56@tcp t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:2.0:1786034751.367417:0:15041:0:(genops.c:1406:class_connect()) connect: client edfa1456-b35c-4b5b-9356-fefb374c3cea, cookie 0x490975051af40fd8 00002000:00100000:2.0:1786034751.367427:0:15041:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli edfa1456-b35c-4b5b-9356-fefb374c3cea/ffff964574ca1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113834 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786034751.367438:0:15041:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786034751.367644:0:15041:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786034751.367676:0:15041:0:(import.c:65:import_set_state_nolock()) ffff964574ca0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786034751.367738:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:2361:x1872792608950272:12345-192.168.203.56@tcp:8:mount.lustre.0 Request processed in 370us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034751.367746:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:1.0:1786034751.368093:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:13891:x1872792608950528:12345-192.168.203.56@tcp:33:mount.lustre.0 Request processed in 1389us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034751.368101:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 1 00000100:00100000:0.0:1786034751.368352:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 13 00000100:00100000:0.0:1786034751.368359:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1872792608950400:12345-192.168.203.56@tcp:8:mount.lustre.0 00010000:00080000:0.0:1786034751.368378:0:15040:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from edfa1456-b35c-4b5b-9356-fefb374c3cea@192.168.203.56@tcp t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:0.0:1786034751.368399:0:15040:0:(genops.c:1406:class_connect()) connect: client edfa1456-b35c-4b5b-9356-fefb374c3cea, cookie 0x490975051af40fdf 00002000:00100000:0.0:1786034751.368406:0:15040:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli edfa1456-b35c-4b5b-9356-fefb374c3cea/ffff96444791c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113834 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786034751.368413:0:15040:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786034751.368607:0:15040:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786034751.368625:0:15040:0:(import.c:65:import_set_state_nolock()) ffff96444791e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786034751.368652:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:2361:x1872792608950400:12345-192.168.203.56@tcp:8:mount.lustre.0 Request processed in 292us (2197us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034751.368660:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 13 00010000:00010000:2.0:1786034751.664301:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034751.673019:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034751.673791:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608950656 00000100:00100000:1.0:1786034751.673801:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608950656 00000100:00100000:1.0:1786034751.675593:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:1.0:1786034751.675609:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:13921:x1872792608950656:12345-192.168.203.56@tcp:101:mkdir.0 00010000:00010000:1.0:1786034751.675629:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034751.676092:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af40fe6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758a9c expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034751.676163:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af40fed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034751.676192:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af40fed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034751.676205:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af40fed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034751.676525:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786034751.676530:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1786034751.676615:0:14358:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af40fed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034751.677304:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af40fe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a9c expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034751.677336:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af40fed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a9c expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034751.677346:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9645821d2c00) 00010000:00010000:1.0:1786034751.677349:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786034751.677353:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724b000, rc 0) 00000100:00100000:1.0:1786034751.677416:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+7:13921:x1872792608950656:12345-192.168.203.56@tcp:101:mkdir.0 Request processed in 1812us (4405us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034751.677424:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 14 00000001:00100000:3.0:1786034752.679787:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of edfa1456-b35c-4b5b-9356-fefb374c3cea 00000001:00100000:3.0:1786034752.679819:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5dad3ced-da50-4764-ac1e-c77a2e771b85 00010000:00010000:2.0:1786034752.689723:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786034753.664917:0:6746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of edfa1456-b35c-4b5b-9356-fefb374c3cea 00010000:00010000:2.0:1786034753.712029:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034754.608097:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636213120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786034754.608183:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034754.608491:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636213504:0@lo:400:kworker.0 00000100:00100000:0.0:1786034754.608533:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034754.608557:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034754.608562:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636213632:0@lo:400:kworker.0 00000100:00100000:0.0:1786034754.608583:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034754.608617:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636213504 00000100:00100000:0.0:1786034754.608625:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636213504 00000100:00100000:0.0:1786034754.608675:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636213632 00000100:00100000:0.0:1786034754.608679:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636213632 00000100:00100000:0.0:1786034754.608710:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786034754.608719:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636213504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034754.608780:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636213504:12345-0@lo:400:kworker.0 Request processed in 62us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034754.608789:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786034754.608851:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786034754.608859:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636213632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034754.608894:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872792636213632:12345-0@lo:400:kworker.0 Request processed in 36us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034754.608900:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1786034754.608921:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034754.608933:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636213376:0@lo:400:kworker.0 00000100:00100000:0.0:1786034754.608968:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872792636213632:0@lo:400:kworker.0 00000100:00100000:3.0:1786034754.608976:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034754.608985:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636213504:0@lo:400:kworker.0 00000100:00100000:3.0:1786034754.609002:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786034754.609010:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457514ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3308:1872792636213248:0@lo:400:kworker.0 00000100:00100000:0.0:1786034754.609019:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636213376 00000100:00100000:0.0:1786034754.609024:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636213376 00000100:00100000:3.0:1786034754.609040:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034754.609066:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786034754.609071:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636213760:0@lo:400:kworker.0 00000100:00100000:0.0:1786034754.609076:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636213376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034754.609100:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034754.609123:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636213376:12345-0@lo:400:kworker.0 Request processed in 50us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034754.609134:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636213376:0@lo:400:kworker.0 00000100:00100000:0.0:1786034754.609143:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786034754.609165:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636213248 00000100:00100000:0.0:1786034754.609168:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636213248 00000100:00100000:0.0:1786034754.609192:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1786034754.609199:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3308:x1872792636213248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034754.609230:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3308:x1872792636213248:12345-0@lo:400:kworker.0 Request processed in 33us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034754.609240:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1786034754.609264:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786034754.609279:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457514ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3308:1872792636213248:0@lo:400:kworker.0 00000100:00100000:0.0:1786034754.609293:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636213760 00000100:00100000:0.0:1786034754.609306:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636213760 00000100:00100000:0.0:1786034754.609328:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786034754.609334:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636213760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034754.609369:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636213760:12345-0@lo:400:kworker.0 Request processed in 34us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034754.609375:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1786034754.609390:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034754.609419:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636213760:0@lo:400:kworker.0 00000100:00100000:2.0:1786034754.610209:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636213120 00000100:00100000:2.0:1786034754.610216:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636213120 00000100:00100000:2.0:1786034754.610272:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786034754.610281:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636213120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034754.610324:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034754.610376:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636213120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034754.610383:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1786034754.610843:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786034754.610928:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636213120:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1786034754.694789:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of edfa1456-b35c-4b5b-9356-fefb374c3cea 00010000:00010000:2.0:1786034754.736071:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034755.632931:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786034755.632955:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636213888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786034755.633035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034755.633104:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636213888 00000100:00100000:0.0:1786034755.633111:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636213888 00000100:00100000:0.0:1786034755.633155:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786034755.633163:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636213888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034755.633198:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034755.633243:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636213888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034755.633250:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786034755.633303:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636213888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786034755.761846:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786034756.177168:0:16327:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1786034756.454014:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034756.454312:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034756.454379:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034756.454405:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034756.454450:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608950784 00000100:00100000:2.0:1786034756.454458:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608950784 00000100:00100000:2.0:1786034756.454507:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 107 00000100:00100000:2.0:1786034756.454533:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:2364:x1872792608950784:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034756.454673:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:2364:x1872792608950784:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 157us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034756.454681:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 107 00000100:00100000:2.0:1786034756.458071:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608951296 00000100:00100000:2.0:1786034756.458091:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608951296 00000100:00100000:2.0:1786034756.458169:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 26 00000100:00100000:2.0:1786034756.458179:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:2364:x1872792608951296:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034756.458248:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:2364:x1872792608951296:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 71us (3868us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034756.458256:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 26 00000100:00100000:0.0:1786034756.459972:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034756.459994:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034756.460379:0:15468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608951040 00000100:00100000:1.0:1786034756.460396:0:15468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608951040 00000100:00080000:1.0:1786034756.460409:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034756.460423:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608950912 00000100:00100000:1.0:1786034756.460425:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608950912 00000100:00100000:1.0:1786034756.460466:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 27 00000100:00100000:1.0:1786034756.460475:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:2364:x1872792608950912:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034756.460520:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:2364:x1872792608950912:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 47us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034756.460528:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 27 00000100:00080000:1.0:1786034756.460619:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786034756.460636:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786034756.460664:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608951552 00000100:00100000:1.0:1786034756.460668:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608951552 00000100:00100000:1.0:1786034756.460696:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00100000:1.0:1786034756.460702:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2364:x1872792608951040:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034756.460728:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2364:x1872792608951040:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 27us (6418us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034756.460734:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00100000:1.0:1786034756.460747:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:1.0:1786034756.460753:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:2364:x1872792608951552:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034756.460772:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:2364:x1872792608951552:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 20us (6367us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034756.460778:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00080000:1.0:1786034756.460789:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786034756.463428:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608951168 00000100:00100000:0.0:1786034756.463439:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608951168 00000100:00100000:0.0:1786034756.463488:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00100000:0.0:1786034756.463496:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2364:x1872792608951168:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034756.463546:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2364:x1872792608951168:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 50us (3549us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034756.463553:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00080000:0.0:1786034756.463580:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786034756.464712:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034756.464777:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608951424 00000100:00100000:2.0:1786034756.464783:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608951424 00000100:00100000:2.0:1786034756.464842:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:2.0:1786034756.464850:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:2364:x1872792608951424:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:2.0:1786034756.464888:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:2364:x1872792608951424:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 38us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034756.464895:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00080000:0.0:1786034756.465444:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786034756.784205:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786034757.232517:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786034757.813382:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034758.831961:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034759.732127:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636214016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034759.732210:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034759.732334:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636214016 00000100:00100000:0.0:1786034759.732343:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636214016 00000100:00100000:0.0:1786034759.732408:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1786034759.732472:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786034759.732498:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636214016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786034759.732537:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034759.732590:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636214016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034759.732597:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786034759.732676:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636214016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786034759.734203:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636214272:0@lo:400:kworker.0 00000100:00100000:1.0:1786034759.734247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034759.734280:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786034759.734286:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636214400:0@lo:400:kworker.0 00000100:00100000:1.0:1786034759.734311:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034759.734338:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636214272 00000100:00100000:1.0:1786034759.734342:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636214272 00000100:00100000:1.0:1786034759.734376:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786034759.734382:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636214272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034759.734425:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636214272:12345-0@lo:400:kworker.0 Request processed in 34us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034759.734431:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786034759.734452:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636214400 00000100:00100000:1.0:1786034759.734455:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636214400 00000100:00100000:1.0:1786034759.734476:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786034759.734481:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636214400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034759.734507:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872792636214400:12345-0@lo:400:kworker.0 Request processed in 25us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034759.734512:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786034759.734532:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3310:1872792636214144:0@lo:400:kworker.0 00000100:00100000:1.0:1786034759.734558:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034759.734577:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636214656:0@lo:400:kworker.0 00000100:00100000:1.0:1786034759.734595:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034759.734609:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786034759.734613:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636214528:0@lo:400:kworker.0 00000100:00100000:1.0:1786034759.734629:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034759.734647:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636214144 00000100:00100000:1.0:1786034759.734655:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636214144 00000100:00100000:1.0:1786034759.734679:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786034759.734684:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3310:x1872792636214144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034759.734711:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3310:x1872792636214144:12345-0@lo:400:kworker.0 Request processed in 27us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034759.734716:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786034759.734739:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636214656 00000100:00100000:1.0:1786034759.734743:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636214656 00000100:00100000:1.0:1786034759.734759:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636214528 00000100:00100000:1.0:1786034759.734761:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636214528 00000100:00100000:1.0:1786034759.734772:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786034759.734777:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636214656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034759.734800:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872792636214656:12345-0@lo:400:kworker.0 Request processed in 23us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034759.734806:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786034759.734814:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786034759.734819:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636214528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034759.734861:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872792636214528:12345-0@lo:400:kworker.0 Request processed in 42us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034759.734867:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1786034759.734883:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786034759.734887:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786034759.734905:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872792636214528:0@lo:400:kworker.0 00000100:00100000:1.0:1786034759.734912:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3310:1872792636214144:0@lo:400:kworker.0 00000100:00100000:1.0:1786034759.734920:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872792636214656:0@lo:400:kworker.0 00000100:00100000:1.0:1786034759.734946:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872792636214400:0@lo:400:kworker.0 00000100:00100000:1.0:1786034759.734961:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636214272:0@lo:400:kworker.0 00010000:00010000:2.0:1786034759.858537:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034760.752078:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786034760.752101:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636214784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786034760.752166:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034760.754606:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636214784 00000100:00100000:2.0:1786034760.754616:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636214784 00000100:00100000:2.0:1786034760.754710:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786034760.754719:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636214784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786034760.754753:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034760.754837:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636214784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (2655us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034760.754845:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786034760.754929:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636214784:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786034760.889792:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786034761.010705:0:16475:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4e765720 20000000:00000080:2.0:1786034761.010720:0:16475:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9644459e6400 uarg=0000000000000000 20000000:01000000:2.0:1786034761.010754:0:16475:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1786034761.010759:0:16475:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1786034761.010764:0:16475:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1786034761.030019:0:16476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1786034761.030289:0:16475:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1786034761.046018:0:16475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1786034761.047321:0:16475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034761.047338:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964542df9c00/0x490975051af40ceb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40ce4 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034761.047345:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964542df9800/0x490975051af40d38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40d31 expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034761.047351:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964548aa7600/0x490975051af40e73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40e6c expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034761.047358:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964542df8200/0x490975051af40f92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a10 expref: 12 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034761.047364:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96444724ac00/0x490975051af40fca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a72 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034761.047370:0:16475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034761.047408:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96444724ac00/0x490975051af40fca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a72 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034761.047432:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96444724ac00/0x490975051af40fca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a72 expref: 12 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034761.047445:0:16475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1872792636214912:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034761.050167:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964542df8200/0x490975051af40f92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a10 expref: 12 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034761.050197:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964542df8200/0x490975051af40f92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a10 expref: 12 pid: 14348 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034761.050210:0:16475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1872792636215040:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034761.050260:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964548aa7600/0x490975051af40e73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af40e6c expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034761.050269:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964548aa7600/0x490975051af40e73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af40e6c expref: 18 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034761.050276:0:16475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1872792636215168:0@lo:104: 00000100:00100000:2.0:1786034761.050310:0:16475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786034761.050342:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964542df9800/0x490975051af40d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af40d31 expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034761.050348:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964542df9800/0x490975051af40d38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af40d31 expref: 18 pid: 14348 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034761.050355:0:16475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1872792636215296:0@lo:104: 00000100:00100000:2.0:1786034761.050370:0:16475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786034761.050388:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964542df9c00/0x490975051af40ceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x490975051af40ce4 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034761.050395:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964542df9c00/0x490975051af40ceb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x490975051af40ce4 expref: 18 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034761.050401:0:16475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1872792636215424:0@lo:104: 00000100:00100000:2.0:1786034761.050433:0:16475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034761.050450:0:16475:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d58d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786034761.055187:0:14339:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786034761.055215:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636215168 00000100:00100000:0.0:1786034761.055223:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636215168 00000100:00100000:0.0:1786034761.055273:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636215296 00000100:00100000:0.0:1786034761.055276:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636215296 00000100:00100000:0.0:1786034761.055287:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636215424 00000100:00100000:0.0:1786034761.055289:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636215424 00000100:00100000:0.0:1786034761.055306:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786034761.055314:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+5:16475:x1872792636215168:12345-0@lo:104: 00010000:00010000:0.0:1786034761.055330:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af40e73 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.055481:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1786034761.056127:0:15267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786034761.056135:0:15267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af40e73 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034761.056144:0:15267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312400 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:1.0:1786034761.056148:0:15267:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af40e73 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034761.056156:0:15267:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af40e73 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786034761.056163:0:15267:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af40e73 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786034761.056169:0:15267:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786034761.056208:0:15267:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40e73 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034761.056215:0:15267:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786034761.056235:0:15267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40e73 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034761.056241:0:15267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964562312400/0x490975051af40e6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40e73 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034761.056264:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034761.056266:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034761.056267:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034761.056288:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786034761.056301:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457dbc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3307:1872792636215552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786034761.056337:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034761.056377:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636215552 00000100:00100000:1.0:1786034761.056382:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636215552 00010000:00010000:1.0:1786034761.056402:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964548aa7600/0x490975051af40e73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af40e6c expref: 19 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034761.056436:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786034761.056443:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3307:x1872792636215552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786034761.056453:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034761.056458:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964548aa7600/0x490975051af40e73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af40e6c expref: 19 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034761.056467:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964548aa7600/0x490975051af40e73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af40e6c expref: 19 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034761.056577:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034761.056606:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3307:x1872792636215552:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034761.056613:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786034761.056647:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457dbc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3307:1872792636215552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034761.057769:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+5:16475:x1872792636215168:12345-0@lo:104: Request processed in 2451us (7454us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034761.057779:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786034761.057813:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786034761.057837:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+4:16475:x1872792636215296:12345-0@lo:104: 00010000:00010000:0.0:1786034761.057849:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af40d38 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.057903:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786034761.058087:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+4:16475:x1872792636215296:12345-0@lo:104: Request processed in 268us (7716us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034761.058094:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786034761.058110:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786034761.058117:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964444bb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+3:16475:x1872792636215424:12345-0@lo:104: 00010000:00010000:0.0:1786034761.058126:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af40ceb expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.058162:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1786034761.058166:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964444bb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+3:16475:x1872792636215424:12345-0@lo:104: Request processed in 51us (7745us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034761.058172:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1786034761.058209:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786034761.058216:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af40d38 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.058223:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d00800 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034761.058226:0:14345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af40d38 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.058234:0:14345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af40d38 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034761.058261:0:14345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af40d38 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034761.058267:0:14345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786034761.058287:0:14345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40d38 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.058294:0:14345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034761.058310:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40d38 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.058318:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964574d00800/0x490975051af40d31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40d38 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.058330:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786034761.058333:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x490975051af40ceb expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.058339:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964574d01200 already unused, calling callback (ffffffffc1d45c20) 10000000:00010000:0.0:1786034761.058342:0:14345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x490975051af40ceb expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.058350:0:14345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x490975051af40ceb expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786034761.058357:0:14345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x490975051af40ceb expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786034761.058362:0:14345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786034761.058380:0:14345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40ceb expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.058387:0:14345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786034761.058392:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40ceb expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.060646:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.156@tcp lock: ffff964574d01200/0x490975051af40ce4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x490975051af40ceb expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.060673:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034761.060675:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786034761.060677:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034761.060693:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3309:1872792636215680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034761.060740:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034761.060774:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034761.060780:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3309:1872792636215808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034761.060803:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034761.060889:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00010000:00010000:1.0:1786034761.061605:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034761.061918:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636215680 00000100:00100000:1.0:1786034761.061926:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636215680 00010000:00010000:1.0:1786034761.061955:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964542df9800/0x490975051af40d38 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af40d31 expref: 19 pid: 14348 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034761.061974:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636215808 00000100:00100000:1.0:1786034761.061986:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636215808 00010000:00010000:1.0:1786034761.061996:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964542df9c00/0x490975051af40ceb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af40ce4 expref: 20 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034761.062006:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608951680 00000100:00100000:1.0:1786034761.062008:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608951680 00010000:00010000:1.0:1786034761.062016:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96444724ac00/0x490975051af40fca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a72 expref: 13 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034761.062026:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786034761.062033:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+20:3309:x1872792636215680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786034761.062044:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034761.062050:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964542df9800/0x490975051af40d38 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af40d31 expref: 20 pid: 14348 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034761.062059:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964542df9800/0x490975051af40d38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af40d31 expref: 20 pid: 14348 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034761.062075:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034761.062117:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+20:3309:x1872792636215680:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034761.062123:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786034761.062136:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786034761.062141:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3309:x1872792636215808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786034761.062147:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034761.062150:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964542df9c00/0x490975051af40ceb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x490975051af40ce4 expref: 19 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034761.062157:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964542df9c00/0x490975051af40ceb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x490975051af40ce4 expref: 19 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034761.062174:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034761.062195:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3309:x1872792636215808:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034761.062200:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786034761.062234:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 7 00000100:00100000:1.0:1786034761.062239:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:2362:x1872792608951680:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034761.062245:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034761.062249:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96444724ac00/0x490975051af40fca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a72 expref: 13 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034761.062268:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96444724ac00/0x490975051af40fca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a72 expref: 13 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034761.062276:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034761.062309:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:2362:x1872792608951680:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 70us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034761.062314:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 7 00000100:00100000:0.0:1786034761.062991:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034761.063029:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3309:1872792636215808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034761.063037:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3309:1872792636215680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786034761.063061:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608951808 00000100:00100000:0.0:1786034761.063064:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608951808 00010000:00010000:0.0:1786034761.063076:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964542df8200/0x490975051af40f92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a10 expref: 13 pid: 14348 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034761.063089:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 8 00000100:00100000:0.0:1786034761.063094:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:2362:x1872792608951808:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034761.063106:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034761.063110:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964542df8200/0x490975051af40f92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a10 expref: 13 pid: 14348 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.063118:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964542df8200/0x490975051af40f92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a10 expref: 13 pid: 14348 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.063129:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.063137:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.063149:0:14341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.063155:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.063160:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.063166:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.063171:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6a00 already unused, calling callback (ffffffffc1761020) 00010000:00010000:0.0:1786034761.063174:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.063181:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.063196:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034761.063204:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034761.063223:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:2362:x1872792608951808:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 129us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034761.063229:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 8 00010000:00010000:2.0:1786034761.064264:0:16475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964548aa7600/0x490975051af40e73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af40e6c expref: 18 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034761.064279:0:16475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1872792636215168:0@lo:104: 00010000:00010000:3.0:1786034761.064346:0:16475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964542df9800/0x490975051af40d38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af40d31 expref: 17 pid: 14348 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034761.064357:0:16475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1872792636215296:0@lo:104: 00010000:00010000:3.0:1786034761.064366:0:16475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964542df9c00/0x490975051af40ceb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x490975051af40ce4 expref: 16 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034761.064373:0:16475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1872792636215424:0@lo:104: 00010000:00010000:3.0:1786034761.064384:0:16475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96444724ac00/0x490975051af40fca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a72 expref: 12 pid: 14350 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034761.064404:0:16475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1872792636214912:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034761.064416:0:16475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964542df8200/0x490975051af40f92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a10 expref: 11 pid: 14348 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034761.064438:0:16475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1872792636215040:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034761.064463:0:16475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034761.064481:0:16475:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034761.064759:0:16475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034761.064766:0:16475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964548aa6a00/0x490975051af40ff4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034761.590646:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034761.590685:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034761.590709:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034761.590727:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034761.590743:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034761.590765:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034761.590793:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608952192 00000100:00100000:1.0:1786034761.590801:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608952192 00000100:00100000:1.0:1786034761.590860:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608952448 00000100:00100000:1.0:1786034761.590863:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608952448 00000100:00100000:1.0:1786034761.590886:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608952064 00000100:00100000:1.0:1786034761.590889:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608952064 00000100:00100000:1.0:1786034761.590911:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608952576 00000100:00100000:1.0:1786034761.590914:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608952576 00000100:00100000:1.0:1786034761.590929:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:1.0:1786034761.590938:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2362:x1872792608952192:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034761.591003:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2362:x1872792608952192:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 65us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034761.591015:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:1.0:1786034761.591031:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00100000:1.0:1786034761.591036:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:2362:x1872792608952448:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034761.591059:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:2362:x1872792608952448:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 23us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034761.591065:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00100000:1.0:1786034761.591076:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:1.0:1786034761.591083:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2362:x1872792608952064:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034761.591108:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2362:x1872792608952064:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034761.591113:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:1.0:1786034761.591125:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 17 00000100:00100000:1.0:1786034761.591132:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:2362:x1872792608952576:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034761.591150:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:2362:x1872792608952576:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 20us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034761.591156:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 17 00000100:00100000:1.0:1786034761.591182:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608951936 00000100:00100000:1.0:1786034761.591191:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608951936 00000100:00100000:1.0:1786034761.591217:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608952320 00000100:00100000:1.0:1786034761.591219:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608952320 00000100:00100000:1.0:1786034761.591230:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 31 00000100:00100000:1.0:1786034761.591235:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:2362:x1872792608951936:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034761.591275:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:2362:x1872792608951936:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 39us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034761.591282:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 31 00000100:00100000:1.0:1786034761.591295:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 32 00000100:00100000:1.0:1786034761.591302:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:2362:x1872792608952320:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:1.0:1786034761.591323:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:2362:x1872792608952320:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 23us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034761.591329:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 32 00000100:00080000:1.0:1786034761.591347:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786034761.591351:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034761.591353:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786034761.906633:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786034762.419566:0:14353:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786034762.419574:0:14353:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96457d631000 from 10 10000000:01000000:0.0:1786034762.419579:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786034762.419626:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964542df9400/0x490975051af40ffb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034762.419638:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964542df9400/0x490975051af40ffb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034762.419650:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964542df9400/0x490975051af40ffb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034762.419674:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636215936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786034762.419735:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034762.421736:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454adbf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034762.428585:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636215936 00000100:00100000:2.0:1786034762.428598:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636215936 00000100:00100000:2.0:1786034762.428648:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1786034762.428657:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+16:14353:x1872792636215936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786034762.428673:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034762.428690:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964548aa6800/0x490975051af41002 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af40ffb expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034762.428716:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964548aa6800/0x490975051af41002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af40ffb expref: 17 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034762.428727:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964548aa6800/0x490975051af41002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af40ffb expref: 17 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034762.428736:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6800, rc 0) 00000100:00100000:2.0:1786034762.428811:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:14353:x1872792636215936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (9075us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034762.428817:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1786034762.428891:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636215936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786034762.428907:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964542df9400/0x490975051af40ffb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af41002 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034762.428917:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964542df9400/0x490975051af40ffb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af41002 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034762.428996:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034762.429029:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034762.429055:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034762.429066:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636216064 00000100:00100000:2.0:1786034762.429069:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636216064 00000100:00100000:2.0:1786034762.429090:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1786034762.429096:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:14353:x1872792636216064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034762.429317:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:14353:x1872792636216064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034762.429324:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1786034762.429353:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034762.429380:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786034762.429415:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034762.429428:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034762.429439:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636216192 00000100:00100000:2.0:1786034762.429442:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636216192 00000100:00100000:2.0:1786034762.429462:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1786034762.429468:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:14353:x1872792636216192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786034762.429606:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:14353:x1872792636216192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034762.429613:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1786034762.429648:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786034762.434043:0:16507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1786034762.436393:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1786034762.436438:0:14353:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786034762.436449:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964542df9400/0x490975051af40ffb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af41002 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034762.436461:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964542df9400/0x490975051af40ffb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af41002 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786034762.436472:0:14353:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786034762.436474:0:14353:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9645747a5000 from 10 10000000:01000000:2.0:1786034762.438565:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786034762.438609:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964548aa7a00/0x490975051af41009 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034762.438622:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964548aa7a00/0x490975051af41009 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034762.438633:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964548aa7a00/0x490975051af41009 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034762.438658:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786034762.438718:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034762.438762:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034762.438788:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636216320 00000100:00100000:0.0:1786034762.438796:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636216320 00000100:00100000:0.0:1786034762.438855:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1786034762.438873:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+17:14353:x1872792636216320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786034762.438894:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034762.438907:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df8200/0x490975051af41010 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af41009 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034762.438930:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df8200/0x490975051af41010 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af41009 expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034762.438940:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df8200/0x490975051af41010 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af41009 expref: 18 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034762.438949:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df8200, rc 0) 00000100:00100000:0.0:1786034762.438988:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:14353:x1872792636216320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034762.438994:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1786034762.439694:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786034762.439709:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964548aa7a00/0x490975051af41009 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af41010 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034762.439719:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964548aa7a00/0x490975051af41009 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af41010 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034762.439774:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034762.439805:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034762.441535:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558d583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034762.447986:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636216448 00000100:00100000:0.0:1786034762.447999:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636216448 00000100:00100000:0.0:1786034762.448051:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1786034762.448060:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:14353:x1872792636216448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034762.448365:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:14353:x1872792636216448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (8557us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034762.448374:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1786034762.448593:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786034762.448647:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034762.448696:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034762.448726:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff964560bd6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786034762.448740:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636216576 00000100:00100000:3.0:1786034762.448744:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636216576 00000100:00100000:3.0:1786034762.448774:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1786034762.448783:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:14353:x1872792636216576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034762.448997:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:14353:x1872792636216576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034762.449010:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1786034762.452304:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786034762.457456:0:16509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1786034762.458106:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1786034762.458126:0:14353:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786034762.458136:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964548aa7a00/0x490975051af41009 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af41010 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034762.458147:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964548aa7a00/0x490975051af41009 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af41010 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786034762.458157:0:14353:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786034762.458159:0:14353:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9645751e6000 from 10 10000000:01000000:3.0:1786034762.458162:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786034762.458193:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562312e00/0x490975051af41017 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034762.458201:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.156@tcp lock: ffff964562312e00/0x490975051af41017 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034762.458211:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.156@tcp lock: ffff964562312e00/0x490975051af41017 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034762.458232:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786034762.458300:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034762.458342:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff964446512840 going to sleep for 11 seconds 00000100:00100000:1.0:1786034762.458383:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636216704 00000100:00100000:1.0:1786034762.458389:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636216704 00000100:00100000:1.0:1786034762.458438:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1786034762.458446:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+18:14353:x1872792636216704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786034762.458458:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034762.458468:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96444724b600/0x490975051af4101e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x490975051af41017 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034762.458488:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96444724b600/0x490975051af4101e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x490975051af41017 expref: 19 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034762.458509:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96444724b600/0x490975051af4101e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x490975051af41017 expref: 19 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034762.458525:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724b600, rc 0) 00000100:00100000:1.0:1786034762.458568:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:14353:x1872792636216704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034762.458574:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1786034762.458860:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786034762.458874:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.156@tcp lock: ffff964562312e00/0x490975051af41017 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af4101e expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034762.458883:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.156@tcp lock: ffff964562312e00/0x490975051af41017 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x490975051af4101e expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034762.458940:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034762.458966:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034762.458988:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558f9fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1786034762.459502:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636216832 00000100:00100000:2.0:1786034762.459507:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636216832 00000100:00100000:2.0:1786034762.459540:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1786034762.459547:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:14353:x1872792636216832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034762.459802:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:14353:x1872792636216832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034762.459811:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1786034762.463473:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786034762.463536:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786034762.463605:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034762.463640:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff964558f9fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1786034762.464058:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636216960 00000100:00100000:3.0:1786034762.464065:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636216960 00000100:00100000:3.0:1786034762.464106:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1786034762.464114:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:14353:x1872792636216960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786034762.464299:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:14353:x1872792636216960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034762.464312:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1786034762.464362:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e73795d0-2313-4f03-984a-ce7ce1eccbf3:14353:1872792636216960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786034762.467375:0:16511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1786034762.469647:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1786034762.469670:0:14353:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786034762.469681:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.156@tcp lock: ffff964562312e00/0x490975051af41017 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af4101e expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034762.469693:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.156@tcp lock: ffff964562312e00/0x490975051af41017 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x490975051af4101e expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034762.929158:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034763.042284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034763.042591:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608952704 00000100:00100000:0.0:1786034763.042600:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608952704 00000100:00100000:0.0:1786034763.042651:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 118 00000100:00100000:0.0:1786034763.042661:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+11:13775:x1872792608952704:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786034763.042678:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034763.042694:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964542df9800/0x490975051af41025 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758aa3 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034763.042722:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964542df9800/0x490975051af41025 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758aa3 expref: 12 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034763.042750:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964542df9800/0x490975051af41025 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758aa3 expref: 12 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034763.042760:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9800, rc 0) 00000100:00100000:0.0:1786034763.042818:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+12:13775:x1872792608952704:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 Request processed in 158us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034763.042862:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 118 00000100:00100000:0.0:1786034763.048176:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034763.056309:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608952832 00000100:00100000:2.0:1786034763.056322:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608952832 00000100:00100000:2.0:1786034763.056377:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 119 00000100:00100000:2.0:1786034763.056387:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457651e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+12:13775:x1872792608952832:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034763.056663:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457651e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+12:13775:x1872792608952832:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 Request processed in 277us (8497us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034763.056672:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 119 00000100:00100000:3.0:1786034763.081346:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034763.081633:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608952960 00000100:00100000:1.0:1786034763.081643:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608952960 00000100:00100000:1.0:1786034763.081693:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 120 00000100:00100000:1.0:1786034763.081711:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+12:13775:x1872792608952960:12345-192.168.203.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786034763.081957:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+12:13775:x1872792608952960:12345-192.168.203.56@tcp:503:ll_cfg_requeue.0 Request processed in 247us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034763.081965:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 120 00000100:00100000:2.0:1786034763.097294:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034763.097360:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608953088 00000100:00100000:3.0:1786034763.097368:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608953088 00000100:00100000:3.0:1786034763.097422:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 121 00000100:00100000:3.0:1786034763.097432:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457477a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+12:13775:x1872792608953088:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786034763.097448:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034763.097470:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964562313800/0x490975051af4102c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758aaa expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034763.097497:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964562313800/0x490975051af4102c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758aaa expref: 13 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034763.097508:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964562313800/0x490975051af4102c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758aaa expref: 13 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034763.097517:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562313800, rc 0) 00000100:00100000:3.0:1786034763.097568:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457477a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:13775:x1872792608953088:12345-192.168.203.56@tcp:101:ll_cfg_requeue.0 Request processed in 137us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034763.097574:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 121 00000100:00100000:3.0:1786034763.105862:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034763.107307:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608953216 00000100:00100000:2.0:1786034763.107318:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608953216 00000100:00100000:2.0:1786034763.107363:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 122 00000100:00100000:2.0:1786034763.107371:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457477bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:13775:x1872792608953216:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786034763.107652:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457477bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:13775:x1872792608953216:12345-192.168.203.56@tcp:501:ll_cfg_requeue.0 Request processed in 279us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034763.107670:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 122 00000100:00100000:3.0:1786034763.110362:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034763.110440:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608953344 00000100:00100000:2.0:1786034763.110448:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608953344 00000100:00100000:2.0:1786034763.110505:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 123 00000100:00100000:2.0:1786034763.110514:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457477b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:13775:x1872792608953344:12345-192.168.203.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786034763.110703:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457477b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:13775:x1872792608953344:12345-192.168.203.56@tcp:503:ll_cfg_requeue.0 Request processed in 190us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034763.110711:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 123 00010000:00010000:1.0:1786034763.955268:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034764.849128:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3307:1872792636217088:0@lo:400:kworker.0 00000100:00100000:1.0:1786034764.849195:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034764.849257:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636217600:0@lo:400:kworker.0 00000100:00100000:1.0:1786034764.849283:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034764.849320:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786034764.849326:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636217216:0@lo:400:kworker.0 00000100:00100000:1.0:1786034764.849350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034764.849367:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636217728:0@lo:400:kworker.0 00000100:00100000:1.0:1786034764.849398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034764.849615:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636217600 00000100:00100000:1.0:1786034764.849623:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636217600 00000100:00100000:1.0:1786034764.849676:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636217728 00000100:00100000:1.0:1786034764.849690:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636217728 00000100:00100000:1.0:1786034764.849710:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786034764.849717:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636217600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034764.849763:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872792636217600:12345-0@lo:400:kworker.0 Request processed in 45us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034764.849769:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786034764.849784:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786034764.849790:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636217728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034764.849811:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872792636217728:12345-0@lo:400:kworker.0 Request processed in 21us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034764.849817:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786034764.849852:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636217216 00000100:00100000:1.0:1786034764.849855:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636217216 00000100:00100000:1.0:1786034764.849877:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786034764.849883:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636217216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034764.849909:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636217216:12345-0@lo:400:kworker.0 Request processed in 26us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034764.849914:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1786034764.849929:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786034764.849933:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786034764.849958:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636217216:0@lo:400:kworker.0 00000100:00100000:1.0:1786034764.849966:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872792636217728:0@lo:400:kworker.0 00000100:00100000:1.0:1786034764.849974:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872792636217600:0@lo:400:kworker.0 00000100:00100000:0.0:1786034764.850132:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636217344:0@lo:400:kworker.0 00000100:00100000:0.0:1786034764.850159:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034764.850186:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636217856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786034764.850207:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034764.850233:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786034764.850239:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636217472:0@lo:400:kworker.0 00000100:00100000:0.0:1786034764.850261:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034764.850299:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636217472 00000100:00100000:0.0:1786034764.850304:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636217472 00000100:00100000:0.0:1786034764.850330:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786034764.850336:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636217472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034764.850367:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636217472:12345-0@lo:400:kworker.0 Request processed in 31us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034764.850373:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786034764.850769:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636217856 00000100:00100000:0.0:1786034764.850774:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636217856 00000100:00100000:0.0:1786034764.850795:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636217472:0@lo:400:kworker.0 00000100:00100000:0.0:1786034764.850872:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1786034764.850878:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636217856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786034764.850901:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034764.850935:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636217856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034764.850941:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1786034764.850968:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636217856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034764.851031:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636217088 00000100:00100000:2.0:1786034764.851035:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636217088 00000100:00100000:2.0:1786034764.851069:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1786034764.851077:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457477a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3307:x1872792636217088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786034764.851112:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457477a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3307:x1872792636217088:12345-0@lo:400:kworker.0 Request processed in 37us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034764.851118:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1786034764.851149:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3307:1872792636217088:0@lo:400:kworker.0 00000100:00100000:1.0:1786034764.851213:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636217344 00000100:00100000:1.0:1786034764.851217:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636217344 00000100:00100000:1.0:1786034764.851258:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786034764.851272:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636217344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786034764.851355:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636217344:12345-0@lo:400:kworker.0 Request processed in 84us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034764.851362:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786034764.851714:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636217344:0@lo:400:kworker.0 00000100:00080000:3.0:1786034764.852386:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786034764.976051:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034765.872311:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786034765.872347:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645777a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636217984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786034765.872413:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034765.872651:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636217984 00000100:00100000:0.0:1786034765.872658:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636217984 00000100:00100000:0.0:1786034765.872710:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786034765.872720:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636217984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034765.872751:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034765.872798:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636217984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034765.872805:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786034765.872902:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645777a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636217984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786034766.000179:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034766.142095:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034766.144447:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608953472 00000100:00100000:0.0:1786034766.144458:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608953472 00000100:00100000:0.0:1786034766.144596:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00080000:3.0:1786034766.144604:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786034766.144614:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:14432:x1872792608953472:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786034766.144635:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034766.144654:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af41033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758ab1 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.144743:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4103a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.144756:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4103a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.144767:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4103a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.144782:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af41041 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.144788:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af41041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.144794:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af41041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147469:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af41048 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147487:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af41048 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147496:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af41048 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034766.147602:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1786034766.147607:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034766.147704:0:14357:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af41048 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147728:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4103a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147734:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4103a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147740:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4103a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147746:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034766.147751:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4103a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147759:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4103a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147771:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9645821d2c00) 00010000:00010000:0.0:1786034766.147774:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034766.147778:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4103a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147784:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af4103a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147796:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af41041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147803:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af41041 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147808:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af41041 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147820:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034766.147862:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af41041 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147868:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af41041 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147878:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9645821d2100) 00010000:00010000:0.0:1786034766.147881:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034766.147884:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af41041 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147890:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af41041 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147934:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af41033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ab1 expref: 8 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147950:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9c00/0x490975051af41048 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ab1 expref: 7 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.147958:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9645821d2b00) 00010000:00010000:0.0:1786034766.147960:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034766.147962:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9c00, rc 0) 00000100:00100000:0.0:1786034766.148027:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:14432:x1872792608953472:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 3421us (5941us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034766.148036:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00100000:0.0:1786034766.152794:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034766.158773:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608953728 00000100:00100000:3.0:1786034766.158786:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608953728 00000100:00100000:3.0:1786034766.158855:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:3.0:1786034766.158866:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:14432:x1872792608953728:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786034766.158886:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034766.158908:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af4104f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758ab8 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.158973:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41056 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.158986:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41056 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.158997:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41056 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.159021:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4105d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.159028:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4105d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.159033:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4105d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160569:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af41064 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160583:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af41064 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160597:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af41064 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034766.160609:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1786034766.160869:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41056 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160877:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41056 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160884:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41056 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160889:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034766.160893:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41056 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160900:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41056 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160912:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9645821d2b00) 00010000:00010000:3.0:1786034766.160915:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034766.160920:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41056 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160926:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41056 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160937:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4105d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160944:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4105d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160957:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4105d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160962:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034766.160965:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4105d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160971:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4105d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160979:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96454a119300) 00010000:00010000:3.0:1786034766.160982:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034766.160984:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4105d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.160990:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4105d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.162133:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af4104f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ab8 expref: 10 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.162148:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312200/0x490975051af41064 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ab8 expref: 9 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.162156:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96454a119900) 00010000:00010000:3.0:1786034766.162158:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034766.162161:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312200, rc 0) 00000100:00100000:3.0:1786034766.162235:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+9:14432:x1872792608953728:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 3370us (9447us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1786034766.162252:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:3.0:1786034766.167644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034766.168048:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608953856 00000100:00100000:0.0:1786034766.168057:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608953856 00000100:00100000:0.0:1786034766.168109:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 17 00000100:00100000:0.0:1786034766.168118:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+9:14432:x1872792608953856:12345-192.168.203.56@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1786034766.168225:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+9:14432:x1872792608953856:12345-192.168.203.56@tcp:59:lhsmtool_posix.0 Request processed in 100us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034766.168233:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 17 00000100:00100000:2.0:1786034766.296412:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034766.296508:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608953984 00000100:00100000:3.0:1786034766.296517:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608953984 00000100:00100000:3.0:1786034766.296577:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 18 00000100:00100000:3.0:1786034766.296587:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+9:14438:x1872792608953984:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034766.296607:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034766.296625:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758abf expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.296681:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41079 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.296693:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41079 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.296703:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41079 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.296715:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af41080 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.296721:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af41080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.296727:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af41080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297645:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41079 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297658:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41079 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297664:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41079 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297670:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034766.297674:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41079 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297680:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41079 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297693:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9645821d2c00) 00010000:00010000:3.0:1786034766.297696:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034766.297700:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297705:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297717:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af41080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297723:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af41080 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297728:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af41080 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297732:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034766.297740:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af41080 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297746:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af41080 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297753:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96454a119300) 00010000:00010000:3.0:1786034766.297755:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034766.297757:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af41080 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297763:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af41080 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297795:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41072 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758abf expref: 10 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.297817:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9645821d2c00) 00010000:00010000:3.0:1786034766.297819:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034766.298562:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758abf expref: 10 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.298576:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312a00, rc 0) 00000100:00100000:3.0:1786034766.298646:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+9:14438:x1872792608953984:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 2059us (2242us total) trans 0 rc 301/301 00000100:00100000:3.0:1786034766.298654:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 18 00000100:00100000:3.0:1786034766.306565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034766.306666:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608954112 00000100:00100000:1.0:1786034766.306675:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608954112 00000100:00100000:1.0:1786034766.306724:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:1.0:1786034766.306733:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5dad3ced-da50-4764-ac1e-c77a2e771b85+9:14438:x1872792608954112:12345-192.168.203.56@tcp:700:lfs.0 00000100:00100000:1.0:1786034766.306817:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5dad3ced-da50-4764-ac1e-c77a2e771b85+9:14438:x1872792608954112:12345-192.168.203.56@tcp:700:lfs.0 Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034766.306855:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:1.0:1786034766.310156:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034766.310241:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608954368 00000100:00100000:3.0:1786034766.310249:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608954368 00000100:00100000:3.0:1786034766.310297:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 19 00000100:00100000:3.0:1786034766.310318:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+9:14438:x1872792608954368:12345-192.168.203.56@tcp:36:lfs.0 00010000:00010000:3.0:1786034766.310367:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034766.310401:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af40fb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a3a expref: 9 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.310419:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9645821d2c00) 00010000:00010000:3.0:1786034766.310424:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034766.310661:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.310675:0:14358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af40fed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a9c expref: 5 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.310684:0:14358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.310713:0:14358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af40fed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a9c expref: 5 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.310727:0:14358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af40fed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a9c expref: 5 pid: 14358 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034766.310742:0:14358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14358:1872792636218112:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034766.310965:0:14358:0:(client.c:2702:ptlrpc_set_wait()) set ffff964549eb1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034766.318304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034766.319184:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608954496 00000100:00100000:0.0:1786034766.319194:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608954496 00010000:00010000:0.0:1786034766.319265:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af40fed lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a9c expref: 6 pid: 14358 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034766.319305:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00100000:0.0:1786034766.319313:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:2362:x1872792608954496:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034766.319328:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034766.319335:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af40fed lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a9c expref: 6 pid: 14358 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.319348:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af40fed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a9c expref: 6 pid: 14358 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.319369:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9645821d2c00) 00010000:00010000:0.0:1786034766.319384:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.319393:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.319427:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.319452:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034766.319502:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:2362:x1872792608954496:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 188us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034766.319509:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00080000:1.0:1786034766.321468:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786034766.325095:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af40fed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758a9c expref: 5 pid: 14358 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034766.325118:0:14358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14358:1872792636218112:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034766.325155:0:14358:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.325165:0:14358:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.325171:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.325194:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4108e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.325205:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4108e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.325224:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4108e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034766.333506:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1786034766.333523:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.333534:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.333553:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.333559:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034766.333563:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.333571:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.333587:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9645821d2c00) 00010000:00010000:2.0:1786034766.333591:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034766.333595:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.333602:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313400/0x490975051af41087 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786034766.333623:0:14358:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000002fefbb48 reply state 000000006c1724e8 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4108e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034766.333632:0:14358:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786034766.333765:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+10:14438:x1872792608954368:12345-192.168.203.56@tcp:36:lfs.0 Request processed in 23445us (23611us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1786034766.333774:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 19 00010000:00010000:3.0:1786034766.355453:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4108e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.355469:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4108e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.355477:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4108e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.355485:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034766.355489:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4108e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.355497:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4108e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.355526:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96454a119300) 00010000:00010000:3.0:1786034766.355530:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034766.355535:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4108e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.355541:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af4108e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786034766.448669:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1786034766.525714:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034766.525792:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608954624 00000100:00100000:3.0:1786034766.525809:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608954624 00000100:00100000:3.0:1786034766.525899:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00100000:3.0:1786034766.525908:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+9:14446:x1872792608954624:12345-192.168.203.56@tcp:101:lctl.0 00010000:00010000:3.0:1786034766.525929:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034766.525949:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758ac6 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.526005:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4109c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.526029:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4109c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.526040:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4109c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034766.526094:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786034766.526098:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1786034766.526134:0:14356:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4109c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.526171:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ac6 expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.526187:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312800/0x490975051af4109c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ac6 expref: 10 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.526195:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119300) 00010000:00010000:3.0:1786034766.526198:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786034766.526201:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312800, rc 0) 00000100:00100000:3.0:1786034766.526264:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+10:14446:x1872792608954624:12345-192.168.203.56@tcp:101:lctl.0 Request processed in 356us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034766.526271:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00100000:2.0:1786034766.563812:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034766.564051:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608954752 00000100:00100000:1.0:1786034766.564061:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608954752 00000100:00100000:1.0:1786034766.564119:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 21 00000100:00100000:1.0:1786034766.564128:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:14447:x1872792608954752:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:1.0:1786034766.564147:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034766.564164:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af410a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758acd expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.564231:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724be00/0x490975051af410aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.564261:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724be00/0x490975051af410aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.564272:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724be00/0x490975051af410aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034766.564325:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786034766.564328:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1786034766.564349:0:14358:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96444724be00/0x490975051af410aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.564372:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af410a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758acd expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.564398:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724be00/0x490975051af410aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758acd expref: 6 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.564407:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119300) 00010000:00010000:1.0:1786034766.564410:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786034766.564413:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724be00, rc 0) 00000100:00100000:1.0:1786034766.564629:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:14447:x1872792608954752:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 501us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034766.564637:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 21 00000100:00100000:1.0:1786034766.571451:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034766.571564:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608954880 00000100:00100000:0.0:1786034766.571572:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608954880 00000100:00100000:0.0:1786034766.571625:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:0.0:1786034766.571633:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:14447:x1872792608954880:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:0.0:1786034766.571651:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034766.571669:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af410b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758ad4 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.571727:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af410b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.571740:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af410b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.571752:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af410b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.571766:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af410bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.571772:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af410bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.571792:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af410bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.571926:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af410c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.571935:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af410c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.571943:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af410c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034766.571975:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1786034766.571979:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034766.571999:0:14357:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af410c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572010:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af410b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572016:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af410b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572111:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af410b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572118:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034766.572122:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af410b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572129:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af410b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572146:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119300) 00010000:00010000:0.0:1786034766.572149:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034766.572153:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af410b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572159:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af410b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572170:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af410bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572176:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af410bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572181:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af410bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572186:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034766.572188:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af410bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572193:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af410bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572199:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9645821d2100) 00010000:00010000:0.0:1786034766.572201:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034766.572204:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af410bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572209:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af410bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572257:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af410b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ad4 expref: 8 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572268:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af410c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ad4 expref: 7 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.572275:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9645821d2d00) 00010000:00010000:0.0:1786034766.572277:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786034766.572280:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9000, rc 0) 00000100:00100000:0.0:1786034766.572335:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+7:14447:x1872792608954880:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 703us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034766.572342:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:0.0:1786034766.583096:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034766.583225:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608955136 00000100:00100000:1.0:1786034766.583233:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608955136 00000100:00100000:1.0:1786034766.583285:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 23 00000100:00100000:1.0:1786034766.583295:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+7:14447:x1872792608955136:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:1.0:1786034766.583329:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034766.583347:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af410cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758adb expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034766.583540:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1786034766.583648:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af410cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758adb expref: 9 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.583663:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119300) 00010000:00010000:1.0:1786034766.583666:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786034766.583671:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af410cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758adb expref: 9 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.583684:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724ac00, rc 0) 00000100:00100000:1.0:1786034766.583743:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+8:14447:x1872792608955136:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 449us (655us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1786034766.583750:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 23 00000100:00100000:2.0:1786034766.586173:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034766.586335:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608955392 00000100:00100000:3.0:1786034766.586344:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608955392 00000100:00100000:3.0:1786034766.586461:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 24 00000100:00100000:3.0:1786034766.586471:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+8:14447:x1872792608955392:12345-192.168.203.56@tcp:36:lfs.0 00010000:00010000:3.0:1786034766.586510:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034766.586532:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af410c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ad4 expref: 8 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.586548:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9645821d2d00) 00010000:00010000:3.0:1786034766.586556:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034766.586578:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af410db lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.586590:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af410db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.586609:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af410db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786034766.586789:0:14356:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000015a09840 reply state 0000000033d99574 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af410db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034766.586810:0:14356:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1786034766.586853:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1786034766.586914:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+9:14447:x1872792608955392:12345-192.168.203.56@tcp:36:lfs.0 Request processed in 444us (747us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1786034766.586921:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 24 00010000:00010000:3.0:1786034766.595189:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af410db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.595205:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af410db lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.595222:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af410db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.595229:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034766.595233:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af410db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.595242:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af410db lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.595258:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034766.595261:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1786034766.595974:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af410db lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.595990:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af410db lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034766.596489:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034766.596912:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608955648 00000100:00100000:3.0:1786034766.596920:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608955648 00000100:00100000:3.0:1786034766.596993:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 2 00000100:00100000:3.0:1786034766.597002:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+8:14447:x1872792608955648:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:3.0:1786034766.597245:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+9:14447:x1872792608955648:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 244us (759us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1786034766.597253:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 2 00000100:00100000:0.0:1786034766.617199:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034766.622141:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608955904 00000100:00100000:2.0:1786034766.622167:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608955904 00000100:00100000:2.0:1786034766.622292:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 25 00000100:00100000:2.0:1786034766.622302:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+9:14447:x1872792608955904:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:2.0:1786034766.622327:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034766.622346:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af410e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758ae2 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622436:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af410e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622449:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af410e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622460:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af410e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622473:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af410f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622480:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af410f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622485:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af410f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034766.622616:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1786034766.622714:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af410e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622722:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af410e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622740:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af410e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622745:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034766.622749:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af410e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622756:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af410e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622766:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119300) 00010000:00010000:2.0:1786034766.622769:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034766.622773:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af410e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622778:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af410e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622790:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af410f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622795:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af410f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622800:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af410f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.622804:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034766.622806:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af410f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.624651:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af410f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.624722:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96455a530b00) 00010000:00010000:2.0:1786034766.624725:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034766.624730:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af410f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.624737:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af410f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.624782:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af410e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ae2 expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.624793:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119300) 00010000:00010000:2.0:1786034766.624795:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786034766.624799:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af410e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ae2 expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.624808:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6e00, rc 0) 00000100:00100000:2.0:1786034766.625127:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+10:14447:x1872792608955904:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 2825us (7936us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1786034766.625135:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 25 00000100:00100000:0.0:1786034766.633230:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034766.633364:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608956032 00000100:00100000:3.0:1786034766.633382:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608956032 00000100:00100000:3.0:1786034766.633439:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 26 00000100:00100000:3.0:1786034766.633449:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+10:14447:x1872792608956032:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034766.633472:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034766.633494:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af410fe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758ae9 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.633792:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41105 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.633806:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.633816:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034766.633980:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1786034766.633990:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786034766.634014:0:14356:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.634139:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af410fe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ae9 expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.634157:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41105 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ae9 expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.634166:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034766.634169:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786034766.634172:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312600, rc 0) 00000100:00100000:3.0:1786034766.634228:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+11:14447:x1872792608956032:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 780us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034766.634235:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 26 00000100:00100000:3.0:1786034766.636886:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034766.636940:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608956160 00000100:00100000:1.0:1786034766.636948:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608956160 00000100:00100000:1.0:1786034766.636999:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 3 00000100:00100000:1.0:1786034766.637009:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+11:14447:x1872792608956160:12345-192.168.203.56@tcp:37:lfs.0 00000100:00100000:2.0:1786034766.655931:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:edfa1456-b35c-4b5b-9356-fefb374c3cea+11:14447:x1872792608956160:12345-192.168.203.56@tcp:37:lfs.0 Request processed in 18913us (19041us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034766.655949:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 3 00000100:00100000:0.0:1786034766.661416:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034766.664507:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608956416 00000100:00100000:3.0:1786034766.664519:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608956416 00000100:00100000:2.0:1786034766.664649:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 4 00000100:00100000:2.0:1786034766.664679:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551335850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+11:14447:x1872792608956416:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:2.0:1786034766.665193:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551335850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+12:14447:x1872792608956416:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 515us (3785us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1786034766.665202:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 4 00000100:00100000:2.0:1786034766.685299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034766.685511:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608956544 00000100:00100000:3.0:1786034766.685521:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608956544 00000100:00100000:3.0:1786034766.685575:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 125 00000100:00100000:3.0:1786034766.685585:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:2363:x1872792608956544:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034766.685654:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:2363:x1872792608956544:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 70us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034766.685662:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 125 00000100:00100000:0.0:1786034766.701797:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034766.701868:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034766.701891:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034766.701926:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034766.701953:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608956928 00000100:00100000:0.0:1786034766.701961:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608956928 00000100:00100000:0.0:1786034766.702002:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608956672 00000100:00100000:0.0:1786034766.702004:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608956672 00000100:00100000:0.0:1786034766.702015:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608956800 00000100:00100000:0.0:1786034766.702017:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608956800 00000100:00100000:0.0:1786034766.702026:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608957056 00000100:00100000:0.0:1786034766.702039:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608957056 00000100:00100000:0.0:1786034766.702055:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00100000:0.0:1786034766.702062:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:2362:x1872792608956928:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034766.702123:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:2362:x1872792608956928:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 61us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034766.702130:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00100000:0.0:1786034766.702145:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 21 00000100:00100000:0.0:1786034766.702151:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2363:x1872792608956672:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034766.702170:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2363:x1872792608956672:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 20us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034766.702175:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 21 00000100:00100000:0.0:1786034766.702184:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:0.0:1786034766.702189:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2362:x1872792608956800:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034766.702205:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2362:x1872792608956800:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 16us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034766.702210:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:0.0:1786034766.702232:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 23 00000100:00100000:0.0:1786034766.702238:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:2362:x1872792608957056:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034766.702257:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:2362:x1872792608957056:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 20us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034766.702263:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 23 00000100:00080000:1.0:1786034766.702561:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786034766.702565:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786034766.768344:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034766.770517:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608957184 00000100:00100000:2.0:1786034766.770528:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608957184 00000100:00100000:2.0:1786034766.770577:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 27 00000100:00100000:2.0:1786034766.770586:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+10:14453:x1872792608957184:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:2.0:1786034766.770604:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034766.770622:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4110c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758af0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.770676:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af41113 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.770689:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af41113 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.770700:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af41113 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.770713:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4111a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.770720:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4111a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.770727:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4111a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.771610:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af41121 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.771621:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af41121 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.771629:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af41121 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034766.771656:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1786034766.771660:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786034766.772157:0:14357:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af41121 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772170:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af41113 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772178:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af41113 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772185:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af41113 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772192:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034766.772196:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af41113 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772204:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af41113 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772226:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119300) 00010000:00010000:2.0:1786034766.772235:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034766.772240:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af41113 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772246:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af41113 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772258:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4111a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772263:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4111a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772268:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4111a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772274:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034766.772277:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4111a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772283:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4111a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772291:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96455a530b00) 00010000:00010000:2.0:1786034766.772293:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034766.772296:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4111a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772300:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4111a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772330:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4110c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758af0 expref: 12 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772355:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6000/0x490975051af41121 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758af0 expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034766.772361:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96454a119500) 00010000:00010000:2.0:1786034766.772363:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786034766.772365:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6000, rc 0) 00000100:00100000:2.0:1786034766.772428:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+11:14453:x1872792608957184:12345-192.168.203.56@tcp:101:bash.0 Request processed in 1842us (4091us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034766.772901:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 27 00000100:00100000:0.0:1786034766.783937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034766.784011:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608957440 00000100:00100000:3.0:1786034766.784020:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608957440 00000100:00100000:3.0:1786034766.784086:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 28 00000100:00100000:3.0:1786034766.784096:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+11:14453:x1872792608957440:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:3.0:1786034766.784115:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034766.784134:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41128 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758af7 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.784255:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.784270:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41105 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ae9 expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.784278:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.784309:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41105 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ae9 expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.784320:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41105 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ae9 expref: 11 pid: 14356 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034766.784332:0:14356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14356:1872792636218240:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034766.784407:0:14356:0:(client.c:2702:ptlrpc_set_wait()) set ffff964549eb1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786034766.790769:0:14356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14356:1872792636218240:192.168.203.56@tcp:104: 00010000:00010000:3.0:1786034766.790795:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034766.793606:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034766.793916:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608957568 00000100:00100000:3.0:1786034766.793930:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608957568 00010000:00010000:3.0:1786034766.793964:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41105 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ae9 expref: 12 pid: 14356 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034766.793999:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:3.0:1786034766.794007:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+12:2362:x1872792608957568:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786034766.794027:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034766.794034:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41105 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ae9 expref: 12 pid: 14356 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.794049:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41105 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ae9 expref: 12 pid: 14356 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.794071:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41105 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758ae9 expref: 12 pid: 14356 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.794085:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034766.794090:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.794100:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.794107:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.794173:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786034766.794232:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+11:2362:x1872792608957568:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 225us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034766.794247:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 10 00010000:00010000:1.0:1786034766.796595:0:14356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.796609:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.796652:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af41136 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.796662:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af41136 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.796672:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af41136 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.797715:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a400/0x490975051af4113d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.797726:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a400/0x490975051af4113d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.797733:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a400/0x490975051af4113d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034766.797744:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1786034766.797783:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.797791:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.797798:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.797804:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034766.797808:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.798100:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.798114:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96454a119500) 00010000:00010000:1.0:1786034766.798117:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034766.798121:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.798128:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313600/0x490975051af4112f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786034766.798140:0:14356:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000d857d174 reply state 000000008ba0f0e4 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af41136 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034766.798149:0:14356:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786034766.798185:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41128 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758af7 expref: 14 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.798200:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a400/0x490975051af4113d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758af7 expref: 13 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.798208:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:1.0:1786034766.798220:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1786034766.798223:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724a400, rc 0) 00000100:00100000:1.0:1786034766.798336:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+14:14453:x1872792608957440:12345-192.168.203.56@tcp:101:bash.0 Request processed in 14240us (14406us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1786034766.798344:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 28 00010000:00010000:3.0:1786034766.810983:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af41136 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.810999:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af41136 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.811007:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af41136 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.811013:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724ac00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034766.811017:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af41136 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.811025:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af41136 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.811039:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9645521d1b00) 00010000:00010000:3.0:1786034766.811041:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034766.811046:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af41136 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034766.811051:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ac00/0x490975051af41136 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034766.820356:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034766.820437:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608957696 00000100:00100000:0.0:1786034766.820447:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608957696 00000100:00100000:0.0:1786034766.820503:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 29 00000100:00100000:0.0:1786034766.820513:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+13:14453:x1872792608957696:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:0.0:1786034766.820537:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034766.820556:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af4114b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758afe expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.820622:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41152 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.820635:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41152 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.820646:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41152 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034766.820683:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1786034766.820688:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034766.820706:0:14357:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41152 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.820716:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41152 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.820738:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af4114b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758afe expref: 15 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.820755:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41152 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758afe expref: 14 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034766.820793:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:0.0:1786034766.820795:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786034766.820799:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9000, rc 0) 00000100:00100000:0.0:1786034766.820864:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+14:14453:x1872792608957696:12345-192.168.203.56@tcp:101:bash.0 Request processed in 353us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034766.820870:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 29 00000100:00100000:2.0:1786034766.829397:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034766.829520:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608957952 00000100:00100000:3.0:1786034766.829529:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608957952 00000100:00100000:3.0:1786034766.829579:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 5 00000100:00100000:3.0:1786034766.829589:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+14:14453:x1872792608957952:12345-192.168.203.56@tcp:35:bash.0 00000001:00080000:3.0:1786034766.829972:0:14360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:3.0:1786034766.830074:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+16:14453:x1872792608957952:12345-192.168.203.56@tcp:35:bash.0 Request processed in 485us (685us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1786034766.830082:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 5 00000020:00080000:3.0:1786034766.830087:0:14360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786034766.958771:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034766.958913:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608958208 00000100:00100000:1.0:1786034766.958935:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608958208 00000100:00100000:1.0:1786034766.958992:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 30 00000100:00100000:1.0:1786034766.959002:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+16:14463:x1872792608958208:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:1.0:1786034766.959033:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034766.959052:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724aa00/0x490975051af41159 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b05 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034766.959161:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1786034766.959279:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724aa00/0x490975051af41159 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b05 expref: 18 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.959294:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119300) 00010000:00010000:1.0:1786034766.959297:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786034766.959302:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724aa00/0x490975051af41159 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b05 expref: 18 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034766.959316:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724aa00, rc 0) 00000100:00100000:1.0:1786034766.959373:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+17:14463:x1872792608958208:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 372us (619us total) trans 8589934603 rc 301/301 00000100:00100000:1.0:1786034766.959380:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 30 00000100:00100000:0.0:1786034766.978469:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034766.978686:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608958464 00000100:00100000:3.0:1786034766.978695:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608958464 00000100:00100000:3.0:1786034766.978787:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 6 00000100:00100000:3.0:1786034766.978798:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+17:14463:x1872792608958464:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:3.0:1786034766.979071:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:14463:x1872792608958464:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 274us (609us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1786034766.979080:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 6 00010000:00010000:1.0:1786034767.033549:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034767.064110:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034767.064365:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608958720 00000100:00100000:3.0:1786034767.064375:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608958720 00000100:00100000:3.0:1786034767.064431:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 31 00000100:00100000:3.0:1786034767.064442:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:14466:x1872792608958720:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034767.064463:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034767.064481:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41167 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b0c expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034767.064568:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af4116e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034767.064581:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af4116e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034767.064592:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af4116e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034767.064613:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1786034767.064723:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41167 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b0c expref: 21 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034767.064740:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af4116e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b0c expref: 20 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034767.064748:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:3.0:1786034767.064751:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786034767.064754:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562313000, rc 0) 00000100:00100000:3.0:1786034767.064815:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+20:14466:x1872792608958720:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 375us (713us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1786034767.064863:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 31 00000100:00100000:0.0:1786034767.077903:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034767.077984:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034767.078231:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608958848 00000100:00100000:2.0:1786034767.078240:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608958848 00000100:00100000:2.0:1786034767.078305:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:2.0:1786034767.078317:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+20:2362:x1872792608958848:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034767.078333:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034767.078358:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af4116e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b0c expref: 20 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034767.078378:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:2.0:1786034767.078383:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034767.078438:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:2362:x1872792608958848:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 123us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034767.078445:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:1.0:1786034767.078707:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608958976 00000100:00100000:1.0:1786034767.078712:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608958976 00000100:00100000:1.0:1786034767.078749:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 32 00000100:00100000:1.0:1786034767.078757:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:14466:x1872792608958976:12345-192.168.203.56@tcp:54:lfs.0 00010000:00010000:1.0:1786034767.078808:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af4117c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.078876:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af4117c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.078887:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af4117c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.078914:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af4117c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.078922:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af4117c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.078928:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af4117c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.078933:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724b000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034767.078937:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af4117c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.078943:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af4117c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.078951:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:1.0:1786034767.078954:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786034767.078957:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af4117c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.078962:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af4117c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034767.078997:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:14466:x1872792608958976:12345-192.168.203.56@tcp:54:lfs.0 Request processed in 241us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034767.079009:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 32 00000100:00100000:0.0:1786034767.082674:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034767.083283:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608959232 00000100:00100000:2.0:1786034767.083304:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608959232 00000100:00100000:2.0:1786034767.083356:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 7 00000100:00100000:2.0:1786034767.083364:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:14466:x1872792608959232:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:2.0:1786034767.083578:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+20:14466:x1872792608959232:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 213us (910us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1786034767.083585:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 7 00000040:00080000:1.0:1786034767.472492:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1786034767.680978:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034767.689652:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608959488 00000100:00100000:2.0:1786034767.689673:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608959488 00000100:00100000:2.0:1786034767.689882:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 33 00000100:00100000:2.0:1786034767.689894:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+20:14497:x1872792608959488:12345-192.168.203.56@tcp:101:cat.0 00010000:00010000:2.0:1786034767.689926:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034767.689953:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af41183 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b13 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034767.690078:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af4118a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034767.690095:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af4118a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034767.690109:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af4118a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034767.690121:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1786034767.690519:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af41183 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b13 expref: 23 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034767.690543:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af4118a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b13 expref: 22 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034767.690576:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:2.0:1786034767.690580:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786034767.690584:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6a00, rc 0) 00000100:00100000:2.0:1786034767.690792:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+22:14497:x1872792608959488:12345-192.168.203.56@tcp:101:cat.0 Request processed in 899us (9828us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1786034767.690801:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 33 00000100:00100000:0.0:1786034767.699043:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034767.699135:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608959872 00000100:00100000:1.0:1786034767.699147:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608959872 00000100:00100000:1.0:1786034767.699229:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 1 00000100:00100000:1.0:1786034767.699240:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+22:2362:x1872792608959872:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034767.699259:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034767.699290:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af4118a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b13 expref: 22 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.699413:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:1.0:1786034767.699418:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034767.699493:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+21:2362:x1872792608959872:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 254us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034767.699502:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 1 00000100:00100000:0.0:1786034767.701857:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034767.701977:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608959744 00000100:00100000:3.0:1786034767.701987:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608959744 00000100:00100000:3.0:1786034767.702040:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 8 00000100:00100000:3.0:1786034767.702050:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+21:14497:x1872792608959744:12345-192.168.203.56@tcp:35:cat.0 00000100:00100000:3.0:1786034767.702446:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+22:14497:x1872792608959744:12345-192.168.203.56@tcp:35:cat.0 Request processed in 397us (620us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1786034767.702454:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 8 00000100:00100000:0.0:1786034767.875537:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034767.875657:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608960128 00000100:00100000:1.0:1786034767.875669:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608960128 00000100:00100000:1.0:1786034767.875746:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 34 00000100:00100000:1.0:1786034767.875758:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+22:14504:x1872792608960128:12345-192.168.203.56@tcp:101:dd.0 00010000:00010000:1.0:1786034767.875790:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034767.875815:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af41198 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b1a expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.875969:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b400/0x490975051af4119f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.875985:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b400/0x490975051af4119f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.876015:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b400/0x490975051af4119f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034767.876028:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1786034767.876214:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af41198 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b1a expref: 25 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.876256:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b400/0x490975051af4119f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b1a expref: 24 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034767.876266:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:1.0:1786034767.876269:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034767.876273:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724b400, rc 0) 00000100:00100000:1.0:1786034767.876343:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+24:14504:x1872792608960128:12345-192.168.203.56@tcp:101:dd.0 Request processed in 586us (820us total) trans 8589934609 rc 0/0 00000100:00100000:1.0:1786034767.876351:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 34 00000100:00100000:0.0:1786034767.885964:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034767.886110:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608960384 00000100:00100000:2.0:1786034767.886123:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608960384 00000100:00100000:2.0:1786034767.886212:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 35 00000100:00100000:2.0:1786034767.886225:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+24:14504:x1872792608960384:12345-192.168.203.56@tcp:36:dd.0 00010000:00010000:2.0:1786034767.886296:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786034767.886331:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b400/0x490975051af4119f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b1a expref: 24 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034767.886360:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41152 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758afe expref: 23 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034767.886373:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:2.0:1786034767.886379:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786034767.886647:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034767.886664:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034767.886675:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786034767.886750:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:2.0:1786034767.886777:0:14357:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000b7172f87 reply state 000000009b6a12c1 transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034767.886786:0:14357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786034767.886946:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+25:14504:x1872792608960384:12345-192.168.203.56@tcp:36:dd.0 Request processed in 723us (996us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1786034767.886955:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 35 00000020:00080000:2.0:1786034767.886960:0:14357:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786034767.888530:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034767.888553:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034767.888563:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034767.888582:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034767.888587:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034767.888596:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411ad lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034767.888613:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:3.0:1786034767.888616:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034767.888620:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411ad lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034767.888628:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411ad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786034768.012713:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934609 is committed 00000001:00080000:0.0:1786034768.012733:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:0.0:1786034768.012740:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:0.0:1786034768.012751:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1786034768.043330:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034768.043627:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608960640 00000100:00100000:3.0:1786034768.043638:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608960640 00000100:00100000:3.0:1786034768.043700:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 9 00000100:00100000:3.0:1786034768.043710:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+10:14504:x1872792608960640:12345-192.168.203.56@tcp:35:dd.0 00000100:00080000:1.0:1786034768.043757:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034768.044002:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+11:14504:x1872792608960640:12345-192.168.203.56@tcp:35:dd.0 Request processed in 291us (683us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1786034768.044010:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 9 00010000:00010000:3.0:1786034768.052645:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034768.402870:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034768.403012:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608960768 00000100:00100000:1.0:1786034768.403022:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608960768 00000100:00100000:1.0:1786034768.403086:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 36 00000100:00100000:1.0:1786034768.403096:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+11:14518:x1872792608960768:12345-192.168.203.56@tcp:101:stat.0 00010000:00010000:1.0:1786034768.403118:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034768.403137:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af411b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b21 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403194:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a800/0x490975051af411bb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403234:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a800/0x490975051af411bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403246:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a800/0x490975051af411bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403261:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af411c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403269:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af411c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403276:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af411c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403564:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b200/0x490975051af411c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403573:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b200/0x490975051af411c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403580:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b200/0x490975051af411c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034768.403611:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1786034768.403615:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786034768.403657:0:14356:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b200/0x490975051af411c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403668:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b200/0x490975051af411c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403686:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a800/0x490975051af411bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403692:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a800/0x490975051af411bb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403700:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a800/0x490975051af411bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403706:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034768.403710:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a800/0x490975051af411bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403718:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a800/0x490975051af411bb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403729:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96454a119500) 00010000:00010000:1.0:1786034768.403732:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034768.403736:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a800/0x490975051af411bb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403743:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a800/0x490975051af411bb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403753:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af411c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403759:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af411c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403764:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af411c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403775:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724ba00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034768.403778:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af411c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403784:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af411c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403793:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9645521d1900) 00010000:00010000:1.0:1786034768.403795:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034768.403798:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af411c2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403804:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af411c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.403876:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af411b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b21 expref: 13 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.404067:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b200/0x490975051af411c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b21 expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.404077:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:1.0:1786034768.404080:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786034768.404082:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724b200, rc 0) 00000100:00100000:1.0:1786034768.404142:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+12:14518:x1872792608960768:12345-192.168.203.56@tcp:101:stat.0 Request processed in 1047us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034768.404150:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 36 00000100:00100000:0.0:1786034768.505725:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034768.505804:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608961024 00000100:00100000:1.0:1786034768.505847:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608961024 00000100:00100000:1.0:1786034768.505910:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 37 00000100:00100000:1.0:1786034768.505920:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+12:14524:x1872792608961024:12345-192.168.203.56@tcp:36:truncate.0 00010000:00010000:1.0:1786034768.505971:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034768.505995:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b200/0x490975051af411c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b21 expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.506013:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:1.0:1786034768.506017:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786034768.506226:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af411d0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.506239:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af411d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.506248:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af411d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786034768.506289:0:14358:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934613 00000004:00010000:1.0:1786034768.506310:0:14358:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000003a683e45 reply state 0000000015e8f3c7 transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af411d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034768.506318:0:14358:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786034768.506405:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+14:14524:x1872792608961024:12345-192.168.203.56@tcp:36:truncate.0 Request processed in 486us (687us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1786034768.507497:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 37 00000020:00080000:1.0:1786034768.507503:0:14358:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786034768.529432:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af411d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034768.529448:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af411d0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034768.529469:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af411d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034768.529476:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724b000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034768.529481:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af411d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034768.529490:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af411d0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034768.529505:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:0.0:1786034768.529509:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786034768.529513:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af411d0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034768.529520:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b000/0x490975051af411d0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034768.809939:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034768.810047:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608961152 00000100:00100000:2.0:1786034768.810056:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608961152 00000100:00100000:2.0:1786034768.810112:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 38 00000100:00100000:2.0:1786034768.810121:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+13:14538:x1872792608961152:12345-192.168.203.56@tcp:101:stat.0 00010000:00010000:2.0:1786034768.810143:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034768.810161:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af411d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b28 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810230:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af411de lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810243:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af411de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810255:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af411de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810269:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810292:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810299:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810599:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af411ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810608:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af411ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810616:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af411ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034768.810647:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1786034768.810651:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786034768.810670:0:14357:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af411ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810680:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af411ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810688:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af411de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810695:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af411de lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810702:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af411de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810718:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034768.810723:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af411de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810731:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af411de lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810742:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96454a119500) 00010000:00010000:2.0:1786034768.810745:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034768.810749:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af411de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810755:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af411de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810766:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810772:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810777:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810782:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034768.810785:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810792:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810809:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff96455a530b00) 00010000:00010000:2.0:1786034768.810812:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034768.810815:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810820:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7c00/0x490975051af411e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810890:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7600/0x490975051af411d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b28 expref: 15 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810903:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af411ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b28 expref: 14 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034768.810910:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:2.0:1786034768.810912:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786034768.810915:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6a00, rc 0) 00000100:00100000:2.0:1786034768.810971:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+14:14538:x1872792608961152:12345-192.168.203.56@tcp:101:stat.0 Request processed in 850us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034768.810979:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 38 00000100:00100000:0.0:1786034768.940605:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034768.943426:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608961408 00000100:00100000:1.0:1786034768.943442:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608961408 00000100:00100000:1.0:1786034768.943511:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 39 00000100:00100000:1.0:1786034768.943532:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+14:14548:x1872792608961408:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:1.0:1786034768.943551:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034768.943570:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b200/0x490975051af411f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b2f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034768.943869:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1786034768.944038:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b200/0x490975051af411f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b2f expref: 16 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.944053:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119300) 00010000:00010000:1.0:1786034768.944056:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786034768.944061:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b200/0x490975051af411f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b2f expref: 16 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034768.944073:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724b200, rc 0) 00000100:00100000:1.0:1786034768.944139:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+15:14548:x1872792608961408:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 608us (3547us total) trans 8589934615 rc 301/301 00000100:00100000:1.0:1786034768.944146:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 39 00000100:00100000:0.0:1786034768.957757:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034768.958249:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608961664 00000100:00100000:3.0:1786034768.958262:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608961664 00000100:00100000:3.0:1786034768.958403:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 10 00000100:00100000:3.0:1786034768.958422:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964551337850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+15:14548:x1872792608961664:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:3.0:1786034768.959067:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964551337850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+16:14548:x1872792608961664:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 652us (1322us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1786034768.959085:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 10 00010000:00010000:0.0:1786034769.072487:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034769.093777:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034769.097341:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608961920 00000100:00100000:1.0:1786034769.097355:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608961920 00000100:00100000:1.0:1786034769.097423:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 40 00000100:00100000:1.0:1786034769.097434:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+16:14554:x1872792608961920:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:1.0:1786034769.097454:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034769.097471:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b200/0x490975051af41201 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b36 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.097558:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.097584:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a400/0x490975051af4113d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758af7 expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.097592:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af411ec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b28 expref: 17 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.097599:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.097630:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af411ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b28 expref: 17 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.097642:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af411ec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b28 expref: 17 pid: 14357 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034769.097655:0:14356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457dbc7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14356:1872792636218368:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034769.097741:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a400/0x490975051af4113d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758af7 expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.097751:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a400/0x490975051af4113d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758af7 expref: 17 pid: 14356 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034769.097761:0:14356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457dbc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14356:1872792636218496:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034769.097781:0:14356:0:(client.c:2702:ptlrpc_set_wait()) set ffff964550238cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034769.103800:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034769.103873:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034769.103886:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608962176 00000100:00100000:2.0:1786034769.103897:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608962176 00010000:00010000:2.0:1786034769.103953:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a400/0x490975051af4113d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758af7 expref: 18 pid: 14356 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034769.103985:0:14356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457dbc7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14356:1872792636218368:192.168.203.56@tcp:104: 00000100:00100000:2.0:1786034769.104008:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608962048 00000100:00100000:1.0:1786034769.104015:0:14356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457dbc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14356:1872792636218496:192.168.203.56@tcp:104: 00000100:00100000:3.0:1786034769.104016:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00100000:2.0:1786034769.104016:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608962048 00000100:00100000:3.0:1786034769.104029:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:2362:x1872792608962176:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034769.104031:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af411ec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b28 expref: 19 pid: 14357 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.104052:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034769.104062:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a400/0x490975051af4113d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758af7 expref: 19 pid: 14356 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034769.104062:0:14342:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1786034769.104070:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1786034769.104073:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.104076:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a400/0x490975051af4113d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758af7 expref: 19 pid: 14356 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.104125:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a400/0x490975051af4113d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758af7 expref: 19 pid: 14356 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.104146:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:3.0:1786034769.104152:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.104162:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.104168:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034769.104378:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:2.0:1786034769.104389:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:2362:x1872792608962048:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034769.104398:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034769.104404:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af411ec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b28 expref: 18 pid: 14357 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.104418:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af411ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b28 expref: 18 pid: 14357 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.104433:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6a00/0x490975051af411ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b28 expref: 18 pid: 14357 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034769.104444:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:2362:x1872792608962176:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 409us (648us total) trans 0 rc 0/0 00010000:00010000:2.0:1786034769.104459:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00000100:00100000:1.0:1786034769.104467:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 11 00010000:00010000:2.0:1786034769.104469:0:14342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.104480:0:14342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.104489:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.104516:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786034769.104556:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+16:2362:x1872792608962048:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 169us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034769.104574:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 12 00010000:00010000:1.0:1786034769.104689:0:14356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.104699:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786034769.104718:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1786034769.104905:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b200/0x490975051af41201 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b36 expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.104930:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b36 expref: 16 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.104940:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:1.0:1786034769.104942:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786034769.104945:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724ba00, rc 0) 00000100:00100000:1.0:1786034769.105001:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+16:14554:x1872792608961920:12345-192.168.203.56@tcp:101:bash.0 Request processed in 7567us (11236us total) trans 8589934617 rc 0/0 00000100:00100000:1.0:1786034769.105009:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 40 00000100:00100000:0.0:1786034769.120228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034769.120310:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608962432 00000100:00100000:1.0:1786034769.120322:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608962432 00000100:00100000:1.0:1786034769.120377:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 41 00000100:00100000:1.0:1786034769.120388:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+16:14554:x1872792608962432:12345-192.168.203.56@tcp:36:bash.0 00010000:00010000:1.0:1786034769.120728:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a000/0x490975051af41216 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.120749:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a000/0x490975051af41216 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.120762:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a000/0x490975051af41216 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786034769.120816:0:14358:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000004:00010000:1.0:1786034769.120879:0:14358:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000025151f91 reply state 0000000085c576a7 transno 8589934619 ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a000/0x490975051af41216 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034769.120889:0:14358:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786034769.120989:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:14554:x1872792608962432:12345-192.168.203.56@tcp:36:bash.0 Request processed in 602us (773us total) trans 8589934619 rc 0/0 00000100:00100000:1.0:1786034769.120997:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 41 00000020:00080000:1.0:1786034769.121002:0:14358:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786034769.122857:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a000/0x490975051af41216 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.122870:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a000/0x490975051af41216 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.122877:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a000/0x490975051af41216 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.122903:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034769.122908:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a000/0x490975051af41216 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.122916:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a000/0x490975051af41216 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.122936:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:3.0:1786034769.122939:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034769.122944:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a000/0x490975051af41216 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.122950:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a000/0x490975051af41216 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034769.123345:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034769.123426:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608962560 00000100:00100000:1.0:1786034769.123436:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608962560 00000100:00100000:1.0:1786034769.123488:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 42 00000100:00100000:1.0:1786034769.123498:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:14554:x1872792608962560:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:1.0:1786034769.123520:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034769.123535:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b800/0x490975051af4121d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b3d expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.123592:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b800/0x490975051af4121d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b3d expref: 19 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.123606:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b800/0x490975051af4121d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b3d expref: 19 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.123635:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:1.0:1786034769.123639:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786034769.123641:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724b800, rc 0) 00000100:00100000:1.0:1786034769.123701:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:14554:x1872792608962560:12345-192.168.203.56@tcp:101:bash.0 Request processed in 203us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034769.123708:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 42 00000100:00100000:2.0:1786034769.134794:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034769.134976:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608962688 00000100:00100000:0.0:1786034769.134987:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608962688 00000100:00100000:0.0:1786034769.135069:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 43 00000100:00100000:0.0:1786034769.135079:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:14554:x1872792608962688:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:0.0:1786034769.135103:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034769.135125:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af41224 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b44 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.135248:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af4122b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.135265:0:14357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b36 expref: 20 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.135275:0:14357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af4122b lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.135314:0:14357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b36 expref: 20 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.135329:0:14357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b36 expref: 20 pid: 14356 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034769.135344:0:14357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1872792636218624:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034769.135442:0:14357:0:(client.c:2702:ptlrpc_set_wait()) set ffff964445311540 going to sleep for 11 seconds 00000100:00100000:2.0:1786034769.140081:0:14357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964542f64700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1872792636218624:192.168.203.56@tcp:104: 00010000:00010000:2.0:1786034769.140115:0:14357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af4122b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034769.141813:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034769.141916:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608962816 00000100:00100000:1.0:1786034769.141927:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608962816 00010000:00010000:1.0:1786034769.141973:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b36 expref: 21 pid: 14356 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034769.142017:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 13 00000100:00100000:1.0:1786034769.142027:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+21:2363:x1872792608962816:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034769.142046:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034769.142054:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b36 expref: 21 pid: 14356 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.142068:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b36 expref: 21 pid: 14356 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.142097:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41208 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b36 expref: 21 pid: 14356 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.142115:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:1.0:1786034769.142120:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af4122b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.142146:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af4122b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.142154:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af4122b lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.142187:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034769.142258:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+20:2363:x1872792608962816:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 231us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034769.142266:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 13 00010000:00010000:0.0:1786034769.142969:0:14357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af4122b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.142978:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af4122b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786034769.143044:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1786034769.143049:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786034769.143073:0:14357:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af4122b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.143110:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9200/0x490975051af41224 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b44 expref: 20 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.143128:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af4122b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b44 expref: 19 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.143137:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:0.0:1786034769.143139:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786034769.143141:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9000, rc 0) 00000100:00100000:0.0:1786034769.143187:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:14554:x1872792608962688:12345-192.168.203.56@tcp:101:bash.0 Request processed in 8110us (8406us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034769.143202:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 43 00000100:00100000:2.0:1786034769.147367:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034769.147449:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608963072 00000100:00100000:0.0:1786034769.147460:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608963072 00000100:00100000:0.0:1786034769.147531:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 2 00000100:00100000:0.0:1786034769.147542:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:14554:x1872792608963072:12345-192.168.203.56@tcp:103:bash.0 00010000:00010000:0.0:1786034769.147560:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1786034769.147588:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af4122b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b44 expref: 19 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.147611:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724b800/0x490975051af4121d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b3d expref: 18 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.147651:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9645521d1200) 00010000:00010000:0.0:1786034769.147663:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034769.147730:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+17:14554:x1872792608963072:12345-192.168.203.56@tcp:103:bash.0 Request processed in 188us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034769.147738:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 2 00000100:00100000:1.0:1786034769.158364:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034769.158736:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608963200 00000100:00100000:3.0:1786034769.158750:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608963200 00000100:00100000:3.0:1786034769.158818:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 44 00000100:00100000:3.0:1786034769.158867:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+17:14554:x1872792608963200:12345-192.168.203.56@tcp:58:bash.0 00010000:00010000:3.0:1786034769.158995:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41232 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.159014:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41232 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.159028:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41232 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786034769.162164:0:14358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786034769.162978:0:14358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1786034769.163114:0:14358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1786034769.163559:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+17:14554:x1872792608963200:12345-192.168.203.56@tcp:58:bash.0 Request processed in 4688us (5198us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034769.163573:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 44 00000100:00100000:1.0:1786034769.181373:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034769.185914:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608963328 00000100:00100000:0.0:1786034769.185933:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608963328 00000100:00100000:0.0:1786034769.186022:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 45 00000100:00100000:0.0:1786034769.186035:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+17:14554:x1872792608963328:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:0.0:1786034769.186060:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034769.186086:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41239 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b4b expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.186156:0:14357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41232 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.186169:0:14357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41239 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b4b expref: 18 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.186192:0:14357:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41232 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.186215:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41239 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b4b expref: 18 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.186232:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96454a119e00) 00010000:00010000:0.0:1786034769.186251:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786034769.186256:0:14357:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41239 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b4b expref: 18 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.186265:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9000, rc 0) 00000100:00100000:0.0:1786034769.186347:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:14554:x1872792608963328:12345-192.168.203.56@tcp:101:bash.0 Request processed in 314us (4987us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034769.186356:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 45 00000040:00080000:1.0:1786034769.521091:0:14390:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1786034769.521103:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786034769.521143:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1786034769.521152:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1786034769.521312:0:14390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96457dbc7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14390:1872792636218752:192.168.203.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786034769.523848:0:14390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645502389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786034769.526517:0:14390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96457dbc7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14390:1872792636218752:192.168.203.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786034769.528260:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034769.530431:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608963456 00000100:00100000:2.0:1786034769.530445:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608963456 00000100:00100000:2.0:1786034769.530513:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:2.0:1786034769.530524:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:14555:x1872792608963456:12345-192.168.203.56@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1786034769.530627:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:14555:x1872792608963456:12345-192.168.203.56@tcp:900:lhsmtool_posix.0 Request processed in 104us (2372us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034769.530635:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:3.0:1786034769.534423:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034769.534944:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608963584 00000100:00100000:1.0:1786034769.534956:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608963584 00000100:00100000:1.0:1786034769.535032:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 46 00000100:00100000:1.0:1786034769.535043:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:14555:x1872792608963584:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786034769.535080:0:14358:0:(mdt_handler.c:8007:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786034769.535273:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:14555:x1872792608963584:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 Request processed in 231us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034769.535282:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 46 00000100:00100000:0.0:1786034769.550954:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034769.557531:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608963712 00000100:00100000:2.0:1786034769.557550:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608963712 00000100:00100000:2.0:1786034769.557640:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 47 00000100:00100000:2.0:1786034769.557651:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:14555:x1872792608963712:12345-192.168.203.56@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1786034769.557986:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af41240 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558007:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af41240 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558041:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af41240 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558059:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41247 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558067:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41247 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558075:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41247 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558101:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4124e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558110:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4124e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558117:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4124e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034769.558162:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1786034769.558167:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786034769.558186:0:14357:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4124e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558207:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af41240 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558216:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af41240 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558237:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af41240 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558245:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034769.558250:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af41240 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558259:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af41240 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558273:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96454a119900) 00010000:00010000:2.0:1786034769.558276:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034769.558281:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af41240 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558289:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af41240 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558305:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41247 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558313:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41247 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558319:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41247 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558325:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034769.558328:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41247 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558344:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41247 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558353:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff96455a530000) 00010000:00010000:2.0:1786034769.558355:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034769.558358:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41247 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558364:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41247 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558378:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4124e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558386:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4124e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558391:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4124e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558396:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa6e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034769.558399:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4124e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558405:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4124e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.558809:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96454a119e00) 00010000:00010000:2.0:1786034769.558813:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786034769.558817:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4124e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.559853:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4124e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034769.560164:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:14555:x1872792608963712:12345-192.168.203.56@tcp:34:lhsmtool_posix.0 Request processed in 2511us (9221us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034769.560175:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 47 00000100:00100000:0.0:1786034769.580641:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034769.580778:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608963968 00000100:00100000:2.0:1786034769.580790:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608963968 00000100:00100000:2.0:1786034769.580879:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 48 00000100:00100000:2.0:1786034769.580896:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:14555:x1872792608963968:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786034769.580920:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034769.580943:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af41255 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b52 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.581055:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4125c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.581072:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4125c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.581084:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4125c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786034769.581096:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1786034769.581214:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4125c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.581221:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4125c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.581251:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4125c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.581258:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1786034769.581263:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4125c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.581272:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4125c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.581296:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96454a119e00) 00010000:00010000:2.0:1786034769.581300:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786034769.581305:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4125c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.581312:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af4125c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.581364:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af41255 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b52 expref: 20 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.581376:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96454a119900) 00010000:00010000:2.0:1786034769.581379:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786034769.581383:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af41255 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b52 expref: 20 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.581394:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6e00, rc 0) 00000100:00100000:2.0:1786034769.581971:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:14555:x1872792608963968:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 1076us (1342us total) trans 8589934620 rc 301/301 00000100:00100000:2.0:1786034769.581988:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 48 00000100:00100000:0.0:1786034769.584426:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034769.584632:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608964096 00000100:00100000:2.0:1786034769.584642:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608964096 00000100:00100000:2.0:1786034769.584701:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 49 00000100:00100000:2.0:1786034769.584711:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:14555:x1872792608964096:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786034769.584757:0:14357:0:(mdt_handler.c:8007:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786034769.584875:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:14555:x1872792608964096:12345-192.168.203.56@tcp:53:lhsmtool_posix.0 Request processed in 164us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034769.584884:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 49 00000100:00100000:0.0:1786034769.621603:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034769.622038:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608964352 00000100:00100000:2.0:1786034769.622051:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608964352 00000100:00100000:2.0:1786034769.622122:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 50 00000100:00100000:2.0:1786034769.622133:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:14555:x1872792608964352:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786034769.622158:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034769.622184:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4126a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b59 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786034769.623641:0:14356:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1786034769.623650:0:14356:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1786034769.624927:0:14356:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1786034769.625278:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41271 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.625298:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.625311:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.625395:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af4126a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b59 expref: 22 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.627002:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41271 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b59 expref: 21 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.627019:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96455a530000) 00010000:00010000:2.0:1786034769.627022:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786034769.627026:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7000, rc 0) 00000100:00100000:2.0:1786034769.627116:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+21:14555:x1872792608964352:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 4983us (5525us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1786034769.627126:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 50 00000100:00100000:0.0:1786034769.645604:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034769.645708:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608964608 00000100:00100000:1.0:1786034769.645720:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608964608 00000100:00100000:1.0:1786034769.645805:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 51 00000100:00100000:1.0:1786034769.645816:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+21:14555:x1872792608964608:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786034769.645933:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034769.645970:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7000/0x490975051af41271 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b59 expref: 21 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.645993:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96455a530000) 00010000:00010000:1.0:1786034769.646005:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786034769.646163:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4127f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646181:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4127f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646200:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4127f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646220:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41286 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf69d7718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646226:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41286 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf69d7718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646232:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41286 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf69d7718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646549:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4127f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646569:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4127f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646577:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4127f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646584:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034769.646588:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4127f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646596:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4127f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646607:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96454a119500) 00010000:00010000:1.0:1786034769.646610:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034769.646614:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4127f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646620:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4127f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646632:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41286 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf69d7718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646637:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41286 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf69d7718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646643:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41286 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf69d7718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646648:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724ba00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034769.646657:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41286 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf69d7718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646664:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41286 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf69d7718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646673:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf69d7718 (ffff9645521d1900) 00010000:00010000:1.0:1786034769.646676:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786034769.646679:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41286 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf69d7718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.646684:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724ba00/0x490975051af41286 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf69d7718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034769.651531:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+20:14555:x1872792608964608:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 5700us (5922us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786034769.651546:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 51 00000100:00100000:0.0:1786034769.657316:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034769.657464:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608964736 00000100:00100000:2.0:1786034769.657476:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608964736 00000100:00100000:2.0:1786034769.657542:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 52 00000100:00100000:2.0:1786034769.657553:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964542f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+20:14555:x1872792608964736:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786034769.657579:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034769.657606:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af4128d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b60 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.657649:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af41294 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.657665:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af41294 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.657677:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af41294 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.657964:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af4128d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b60 expref: 22 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.657987:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa6e00/0x490975051af41294 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b60 expref: 21 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.657996:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96455a530b00) 00010000:00010000:2.0:1786034769.657999:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786034769.658002:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa6e00, rc 0) 00000100:00100000:2.0:1786034769.658110:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964542f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+21:14555:x1872792608964736:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 558us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034769.658118:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 52 00000100:00100000:2.0:1786034769.678494:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034769.678606:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608964992 00000100:00100000:1.0:1786034769.678619:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608964992 00000100:00100000:1.0:1786034769.678686:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 53 00000100:00100000:1.0:1786034769.678697:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+21:14555:x1872792608964992:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786034769.678815:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4129b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.678873:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4129b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034769.678896:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4129b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786034769.679382:0:14358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1786034769.679412:0:14358:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 605887588055ns, next at 606887584393ns, rc = 0 00000004:00010000:1.0:1786034769.679515:0:14358:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000ca66ba2e reply state 000000006c62a8bd transno 8589934622 ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4129b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034769.679527:0:14358:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786034769.679639:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+23:14555:x1872792608964992:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 942us (1157us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1786034769.679647:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 53 00010000:00010000:0.0:1786034769.695790:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4129b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.695812:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4129b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.695858:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4129b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.695867:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96444724a600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1786034769.695873:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4129b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.695891:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4129b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.695936:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96455a530b00) 00010000:00010000:0.0:1786034769.695939:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786034769.695945:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4129b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.695952:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96444724a600/0x490975051af4129b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034769.705688:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034769.706070:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608965120 00000100:00100000:0.0:1786034769.706082:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608965120 00000100:00100000:0.0:1786034769.706152:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 54 00000100:00100000:0.0:1786034769.706163:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+22:14555:x1872792608965120:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786034769.706203:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786034769.706231:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af412a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b67 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.706305:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af412a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b67 expref: 23 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.706322:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af412a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b67 expref: 23 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034769.706344:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96455a530b00) 00010000:00010000:0.0:1786034769.706347:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786034769.706352:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964542df9a00, rc 0) 00000100:00100000:0.0:1786034769.706436:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+23:14555:x1872792608965120:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 274us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034769.706464:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 54 00000100:00100000:1.0:1786034769.715553:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034769.715985:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608965248 00000100:00100000:0.0:1786034769.715999:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608965248 00000100:00100000:0.0:1786034769.716132:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:0.0:1786034769.716145:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2362:x1872792608965248:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1786034769.716589:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:2362:x1872792608965248:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 Request processed in 446us (1048us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1786034769.716598:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00080000:1.0:1786034769.717283:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786034769.731170:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034769.731620:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608965504 00000100:00100000:2.0:1786034769.731633:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608965504 00000100:00100000:2.0:1786034769.731704:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00100000:2.0:1786034769.731715:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+23:14555:x1872792608965504:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786034769.732141:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+24:14555:x1872792608965504:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 Request processed in 427us (983us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1786034769.732150:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 11 00000100:00100000:3.0:1786034769.734027:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034769.734585:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608965760 00000100:00100000:2.0:1786034769.734598:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608965760 00000100:00100000:2.0:1786034769.734652:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 55 00000100:00100000:2.0:1786034769.734662:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+24:14555:x1872792608965760:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786034769.745631:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+24:14555:x1872792608965760:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 10953us (11602us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034769.745650:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 55 00000100:00100000:1.0:1786034769.763965:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034769.764208:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608965888 00000100:00100000:3.0:1786034769.764220:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608965888 00000100:00100000:3.0:1786034769.764286:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 56 00000100:00100000:3.0:1786034769.764298:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645777a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+24:14555:x1872792608965888:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786034769.764324:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034769.764349:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af412a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b6e expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.764449:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.764466:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.764479:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034769.764531:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786034769.764553:0:14358:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.764604:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af412a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b6e expref: 26 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.764625:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b6e expref: 25 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034769.764634:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96455a530b00) 00010000:00010000:3.0:1786034769.764638:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786034769.764641:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312a00, rc 0) 00000100:00100000:3.0:1786034769.764714:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645777a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+25:14555:x1872792608965888:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 417us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034769.764721:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 56 00000100:00100000:1.0:1786034769.793874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034769.794021:0:15468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608966016 00000100:00100000:2.0:1786034769.794034:0:15468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608966016 00000100:00100000:2.0:1786034769.794098:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00100000:2.0:1786034769.794109:0:15468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96457514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:2362:x1872792608966016:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786034769.794131:0:15468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034769.794155:0:15468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056f2704a/0x490975051af412b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b75 expref: -99 pid: 15468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786034769.794188:0:15468:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a74ba50, blocks: 0x1 00010000:00010000:2.0:1786034769.794220:0:15468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=606s v=(0 0) 00010000:00010000:2.0:1786034769.794225:0:15468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034769.794237:0:15468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056f2704a/0x490975051af412b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b75 expref: 7 pid: 15468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.794259:0:15468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000056f2704a/0x490975051af412b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b75 expref: 7 pid: 15468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034769.794276:0:15468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7c00, rc 0) 00000100:00100000:2.0:1786034769.794352:0:15468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96457514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:2362:x1872792608966016:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 244us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034769.794359:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00100000:2.0:1786034769.811278:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034769.811367:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608966272 00000100:00100000:3.0:1786034769.811380:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608966272 00000100:00100000:3.0:1786034769.811462:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 57 00000100:00100000:3.0:1786034769.811475:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+25:14555:x1872792608966272:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786034769.811627:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+25:14555:x1872792608966272:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 154us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034769.811636:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 57 00000100:00100000:1.0:1786034769.833654:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034769.833768:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608966400 00000100:00100000:2.0:1786034769.833781:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608966400 00000100:00100000:2.0:1786034769.834522:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 58 00000100:00100000:2.0:1786034769.834537:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9644476c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+25:14555:x1872792608966400:12345-192.168.203.56@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1786034769.976121:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636219008:0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.976180:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034769.976230:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636219520:0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.976250:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034769.976274:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786034769.976280:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3308:1872792636218880:0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.976318:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034769.976340:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636219392:0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.976360:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034769.976385:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636219136:0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.976421:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034769.976440:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786034769.976445:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645752f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636219264:0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.976463:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786034769.976485:0:14356:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1786034769.976492:0:14356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1786034769.976505:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636219008 00000100:00100000:3.0:1786034769.976510:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636219008 00000100:00100000:3.0:1786034769.976553:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636219136 00000100:00100000:3.0:1786034769.976556:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636219136 00000100:00100000:3.0:1786034769.976577:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786034769.976585:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636219008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.976631:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872792636219008:12345-0@lo:400:kworker.0 Request processed in 46us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034769.976637:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786034769.976653:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786034769.976659:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636219136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.976689:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636219136:12345-0@lo:400:kworker.0 Request processed in 30us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034769.976694:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1786034769.976709:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786034769.976713:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786034769.976737:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636219136:0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.976777:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872792636219008:0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.976790:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1786034769.976795:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636219520 00000100:00100000:3.0:1786034769.976798:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636219520 00000100:00080000:3.0:1786034769.976813:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034769.976855:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1786034769.976860:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636219392 00000100:00100000:3.0:1786034769.976862:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636219392 00000100:00080000:3.0:1786034769.976874:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786034769.976885:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1786034769.976889:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636219264 00000100:00100000:3.0:1786034769.976891:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636219264 00000100:00100000:3.0:1786034769.976898:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1786034769.976903:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1786034769.976908:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636219520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.976943:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872792636219520:12345-0@lo:400:kworker.0 Request processed in 34us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034769.976948:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1786034769.976966:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872792636219520:0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.976978:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1786034769.976983:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1786034769.976988:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636219392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.977013:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872792636219392:12345-0@lo:400:kworker.0 Request processed in 25us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034769.977018:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1786034769.977034:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872792636219392:0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.977045:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1786034769.977056:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1786034769.977061:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636219264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786034769.977087:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872792636219264:12345-0@lo:400:kworker.0 Request processed in 26us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034769.977092:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1786034769.977109:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872792636219264:0@lo:400:kworker.0 00000100:00100000:0.0:1786034769.979534:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636218880 00000100:00100000:0.0:1786034769.979544:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636218880 00000100:00100000:0.0:1786034769.979582:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1786034769.979590:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3308:x1872792636218880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786034769.979650:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e73795d0-2313-4f03-984a-ce7ce1eccbf3+19:3308:x1872792636218880:12345-0@lo:400:kworker.0 Request processed in 61us (3331us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034769.979656:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1786034769.980003:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786034769.980016:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636219648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786034769.980046:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786034769.980073:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636219648 00000100:00100000:2.0:1786034769.980076:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636219648 00000100:00100000:2.0:1786034769.980098:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786034769.980103:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636219648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786034769.980126:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786034769.980154:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872792636219648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034769.980159:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786034769.980200:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872792636219648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786034769.981640:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645752f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e73795d0-2313-4f03-984a-ce7ce1eccbf3:3308:1872792636218880:0@lo:400:kworker.0 00000001:00080000:1.0:1786034770.000687:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:1.0:1786034770.000700:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1786034770.000819:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786034770.000857:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9644476c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636219776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786034770.000912:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034770.000947:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636219776 00000100:00100000:1.0:1786034770.000952:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636219776 00000100:00100000:1.0:1786034770.000991:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786034770.001000:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872792636219776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786034770.001203:0:15041:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786034770.001207:0:15041:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1786034770.001209:0:15041:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786034770.001211:0:15041:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1786034768 -> 1786034768 00002000:00010000:1.0:1786034770.001213:0:15041:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786034770.001249:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1872792636219776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 250us (335us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1786034770.001269:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1786034770.001307:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9644476c2680/2, rc 0, transno 8589934595 00000100:00100000:1.0:1786034770.001313:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9644476c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872792636219776:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1786034770.001334:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000100:00100000:3.0:1786034770.001944:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9644476c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+13:14555:x1872792608966400:12345-192.168.203.56@tcp:44:lhsmtool_posix.0 Request processed in 167409us (168302us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034770.001953:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 58 00000100:00100000:1.0:1786034770.018527:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034770.025134:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608966528 00000100:00100000:3.0:1786034770.025147:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608966528 00000100:00100000:3.0:1786034770.025212:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 17 00000100:00100000:3.0:1786034770.025221:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:2363:x1872792608966528:12345-192.168.203.56@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1786034770.025328:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:2363:x1872792608966528:12345-192.168.203.56@tcp:16:lhsmtool_posix.0 Request processed in 107us (6808us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034770.025334:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 17 00000001:00080000:1.0:1786034770.029344:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1786034770.029575:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034770.033558:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608966784 00000100:00100000:3.0:1786034770.033573:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608966784 00000100:00100000:3.0:1786034770.033690:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 59 00000100:00100000:3.0:1786034770.033704:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+13:14555:x1872792608966784:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786034770.033754:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786034770.033780:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b6e expref: 13 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.033813:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96455a530b00) 00010000:00010000:3.0:1786034770.033818:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786034770.033878:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af412be lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786034770.034369:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786034770.034426:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af412be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.034435:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af412be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786034770.034615:0:14358:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000004d18f8c7 reply state 00000000db2a9a7f transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af412be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034770.034624:0:14358:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786034770.034726:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+14:14555:x1872792608966784:12345-192.168.203.56@tcp:36:lhsmtool_posix.0 Request processed in 1026us (5152us total) trans 8589934624 rc 0/0 00000100:00100000:3.0:1786034770.034734:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 59 00000100:00100000:0.0:1786034770.043597:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034770.045020:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608966912 00000100:00100000:1.0:1786034770.045031:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608966912 00000100:00100000:1.0:1786034770.045093:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 18 00000100:00100000:1.0:1786034770.045102:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:14555:x1872792608966912:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786034770.045119:0:15041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786034770.045134:0:15041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af412c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b7c expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.045163:0:15041:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000056f2704a/0x490975051af412b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b75 expref: 7 pid: 15468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.045172:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034770.045177:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786034770.045182:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af412c5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b7c expref: 7 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.045225:0:15041:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000056f2704a/0x490975051af412b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b75 expref: 7 pid: 15468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.045267:0:15041:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000056f2704a/0x490975051af412b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b75 expref: 7 pid: 15468 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034770.045281:0:15041:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15041:1872792636219904:192.168.203.56@tcp:104: 00000100:00100000:1.0:1786034770.045359:0:15041:0:(client.c:2702:ptlrpc_set_wait()) set ffff964550238f00 going to sleep for 11 seconds 00010000:00010000:3.0:1786034770.049516:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af412be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.049532:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af412be lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.049539:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af412be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.049545:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034770.049549:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af412be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.049571:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af412be lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.049587:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96455a530b00) 00010000:00010000:3.0:1786034770.049590:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034770.049595:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af412be lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.049601:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af412be lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034770.055757:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034770.056514:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608967040 00000100:00100000:2.0:1786034770.056524:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608967040 00010000:00010000:2.0:1786034770.056564:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000056f2704a/0x490975051af412b7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b75 expref: 8 pid: 15468 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034770.056608:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:2.0:1786034770.056618:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+8:2362:x1872792608967040:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786034770.056631:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786034770.056652:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000056f2704a/0x490975051af412b7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b75 expref: 8 pid: 15468 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034770.056667:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000056f2704a/0x490975051af412b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b75 expref: 8 pid: 15468 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034770.056712:0:14343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034770.056717:0:14343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034770.056724:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af412c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b7c expref: 8 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034770.056734:0:14343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af412c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b7c expref: 8 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034770.056770:0:14343:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af412c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b7c expref: 8 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786034770.056783:0:14343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574df3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14343:1872792636220032:192.168.203.56@tcp:105: 00000100:00100000:2.0:1786034770.056884:0:14343:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c7513c0 going to sleep for 11 seconds 00010000:00010000:1.0:1786034770.057259:0:15041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056f2704a/0x490975051af412b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b75 expref: 8 pid: 15468 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034770.057273:0:15041:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15041:1872792636219904:192.168.203.56@tcp:104: 00010000:00010000:1.0:1786034770.057296:0:15041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af412c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b7c expref: 7 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.057306:0:15041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96444724a400, rc 0) 00000100:00100000:1.0:1786034770.057334:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:14555:x1872792608966912:12345-192.168.203.56@tcp:101:lhsmtool_posix.0 Request processed in 12232us (13745us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034770.057342:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 18 00000100:00100000:3.0:1786034770.065664:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034770.065747:0:14343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574df3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14343:1872792636220032:192.168.203.56@tcp:105: 00010000:00010000:1.0:1786034770.065767:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034770.065815:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:2362:x1872792608967040:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 9199us (10068us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034770.065844:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:0.0:1786034770.066839:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608967168 00000100:00100000:0.0:1786034770.066846:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608967168 00000100:00100000:0.0:1786034770.066972:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 19 00000100:00100000:0.0:1786034770.066982:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:2363:x1872792608967168:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1786034770.067156:0:15040:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1786034770.067160:0:15040:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1786034768 00002000:00010000:0.0:1786034770.067163:0:15040:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1786034765 00002000:00010000:0.0:1786034770.067176:0:15040:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1786034768 -> 1786034768 00002000:00010000:0.0:1786034770.067178:0:15040:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1786034770.067217:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:2363:x1872792608967168:12345-192.168.203.56@tcp:2:lhsmtool_posix.0 Request processed in 236us (1562us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1786034770.067225:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 19 00000100:00100000:3.0:1786034770.076595:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034770.076725:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608967296 00000100:00100000:0.0:1786034770.076734:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608967296 00000100:00100000:0.0:1786034770.076791:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00100000:0.0:1786034770.076801:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645500a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:2364:x1872792608967296:12345-192.168.203.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786034770.076876:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af412cc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.076905:0:15039:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af412c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b7c expref: 7 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.076914:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786034770.076918:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786034770.076923:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af412cc lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.076959:0:15039:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af412c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b7c expref: 7 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.076981:0:15039:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af412c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b7c expref: 7 pid: 15041 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034770.077011:0:15039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15039:1872792636220160:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034770.077129:0:15039:0:(client.c:2702:ptlrpc_set_wait()) set ffff964553b890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786034770.083415:0:15039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15039:1872792636220160:192.168.203.56@tcp:104: 00010000:00010000:0.0:1786034770.083444:0:15039:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af412cc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034770.085798:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034770.086232:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608967424 00000100:00100000:0.0:1786034770.086240:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608967424 00010000:00010000:0.0:1786034770.086275:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af412c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b7c expref: 8 pid: 15041 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034770.086305:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00100000:0.0:1786034770.086313:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+8:2363:x1872792608967424:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786034770.086326:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786034770.086347:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af412c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b7c expref: 8 pid: 15041 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.086359:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af412c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b7c expref: 8 pid: 15041 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.086378:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083e20e79/0x490975051af412c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b7c expref: 8 pid: 15041 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.086425:0:14341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786034770.086430:0:14341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786034770.086434:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af412cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.086443:0:14341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af412cc lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.086651:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786034770.086705:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:2363:x1872792608967424:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 393us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034770.086713:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 15 00010000:00010000:1.0:1786034770.092140:0:15039:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af412cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.092178:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af412cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.092223:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af412cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.092231:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af412cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.092240:0:15039:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af412cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.092248:0:15039:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df9200 already unused, calling callback (ffffffffc1761020) 00010000:00010000:1.0:1786034770.092253:0:15039:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af412cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.092262:0:15039:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af412cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.092282:0:15039:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af412cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.092290:0:15039:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c958300/0x490975051af412cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034770.092396:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645500a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:2364:x1872792608967296:12345-192.168.203.56@tcp:1:lhsmtool_posix.0 Request processed in 15593us (15805us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034770.093174:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 20 00000100:00100000:3.0:1786034770.095291:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:0.0:1786034770.095356:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608967680 00000100:00100000:0.0:1786034770.095364:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608967680 00000100:00100000:0.0:1786034770.095417:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 60 00000100:00100000:0.0:1786034770.095426:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dad3ced-da50-4764-ac1e-c77a2e771b85+13:14555:x1872792608967680:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786034770.095497:0:16591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af412d3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.095513:0:16591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af412d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.095523:0:16591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af412d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.095737:0:16591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.095754:0:16591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af412a2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b67 expref: 14 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.095761:0:16591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.095791:0:16591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af412a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b67 expref: 14 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.095803:0:16591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af412a2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b67 expref: 14 pid: 14357 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034770.095816:0:16591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16591:1872792636220288:192.168.203.56@tcp:104: 00000100:00100000:0.0:1786034770.095921:0:16591:0:(client.c:2702:ptlrpc_set_wait()) set ffff964445311b40 going to sleep for 11 seconds 00010000:00010000:0.0:1786034770.096269:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786034770.098983:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:1.0:1786034770.099081:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608967808 00000100:00100000:1.0:1786034770.099089:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608967808 00010000:00010000:1.0:1786034770.099119:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af412a2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b67 expref: 15 pid: 14357 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034770.099153:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 16 00000100:00100000:1.0:1786034770.099167:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+15:2362:x1872792608967808:12345-192.168.203.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786034770.099179:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786034770.099185:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af412a2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b67 expref: 15 pid: 14357 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.099207:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af412a2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b67 expref: 15 pid: 14357 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.099227:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96455a530b00) 00010000:00010000:1.0:1786034770.099232:0:14342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.099242:0:14342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.099249:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.099280:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786034770.099321:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+15:2362:x1872792608967808:12345-192.168.203.56@tcp:103:ldlm_bl.0 Request processed in 160us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034770.099328:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 16 00010000:00010000:0.0:1786034770.099597:0:16591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9a00/0x490975051af412a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b67 expref: 14 pid: 14357 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786034770.099611:0:16591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16591:1872792636220288:192.168.203.56@tcp:104: 00010000:00010000:0.0:1786034770.099628:0:16591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.099635:0:16591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786034770.099640:0:16591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786034770.099810:0:16591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1786034770.099989:0:16591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000001:00080000:0.0:1786034770.100045:0:16591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1786034770.100114:0:16591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16591:1872792636220416:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786034770.100154:0:16591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034770.100179:0:16591:0:(client.c:2702:ptlrpc_set_wait()) set ffff964445311300 going to sleep for 11 seconds 00000100:00100000:1.0:1786034770.100345:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636220416 00000100:00100000:1.0:1786034770.100350:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636220416 00000100:00100000:1.0:1786034770.100384:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786034770.100392:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16591:x1872792636220416:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786034770.100459:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16591:x1872792636220416:12345-0@lo:1000:mdt00_003.0 Request processed in 66us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034770.100465:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786034770.100493:0:16591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16591:1872792636220416:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1786034770.101226:0:16591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000100:00100000:1.0:1786034770.101275:0:16591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16591:1872792636220544:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786034770.101307:0:16591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786034770.101325:0:16591:0:(client.c:2702:ptlrpc_set_wait()) set ffff9645502389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786034770.101339:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636220544 00000100:00100000:1.0:1786034770.101344:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636220544 00000100:00100000:1.0:1786034770.101363:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786034770.101368:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16591:x1872792636220544:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786034770.101505:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16591:x1872792636220544:12345-0@lo:1000:mdt00_003.0 Request processed in 136us (197us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1786034770.101512:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786034770.101539:0:16591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16591:1872792636220544:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1786034770.101562:0:16591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101576:0:16591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101583:0:16591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101588:0:16591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9645413f0200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034770.101593:0:16591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101600:0:16591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101612:0:16591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96455a530b00) 00010000:00010000:1.0:1786034770.101614:0:16591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786034770.101618:0:16591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101624:0:16591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9645413f0200/0x490975051af412da lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101648:0:16591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41232 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101654:0:16591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41232 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101661:0:16591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41232 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101665:0:16591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1786034770.101672:0:16591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41232 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101678:0:16591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41232 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101686:0:16591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96454a119e00) 00010000:00010000:1.0:1786034770.101688:0:16591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786034770.101693:0:16591:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41239 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b4b expref: 17 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101703:0:16591:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41239 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b4b expref: 17 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101712:0:16591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41239 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b4b expref: 17 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786034770.101732:0:16591:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff964542df9000/0x490975051af41239 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b4b expref: 17 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034770.101743:0:16591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16591:1872792636220672:192.168.203.56@tcp:105: 00000100:00100000:1.0:1786034770.101782:0:16591:0:(client.c:2702:ptlrpc_set_wait()) set ffff96454c78fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1786034770.104538:0:16591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9645412a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16591:1872792636220672:192.168.203.56@tcp:105: 00010000:00010000:3.0:1786034770.104562:0:16591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41232 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104571:0:16591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af41232 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104598:0:16591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412e1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104611:0:16591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412e1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104620:0:16591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412e1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104639:0:16591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412e1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104645:0:16591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412e1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104650:0:16591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412e1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104654:0:16591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034770.104658:0:16591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412e1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104664:0:16591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412e1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104675:0:16591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96454a119e00) 00010000:00010000:3.0:1786034770.104677:0:16591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034770.104679:0:16591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412e1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104685:0:16591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412e1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104694:0:16591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af412d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104700:0:16591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af412d3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104705:0:16591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af412d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104716:0:16591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964542df8e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034770.104720:0:16591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af412d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104727:0:16591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af412d3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104735:0:16591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96454a119e00) 00010000:00010000:3.0:1786034770.104737:0:16591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786034770.104739:0:16591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af412d3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.104744:0:16591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964542df8e00/0x490975051af412d3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16591 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034770.105226:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dad3ced-da50-4764-ac1e-c77a2e771b85+17:14555:x1872792608967680:12345-192.168.203.56@tcp:57:lhsmtool_posix.0 Request processed in 9800us (9937us total) trans 8589934629 rc 0/0 00000100:00100000:3.0:1786034770.105235:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 60 00000020:00080000:3.0:1786034770.105240:0:16591:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1786034770.106148:0:14390:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1786034770.106153:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786034770.106177:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1786034770.106182:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1786034770.117145:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034770.117223:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034770.125090:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608967936 00000100:00100000:3.0:1786034770.125104:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608967936 00000100:00100000:0.0:1786034770.126512:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608968192 00000100:00100000:0.0:1786034770.126520:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608968192 00000100:00100000:2.0:1786034770.129063:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:2.0:1786034770.129076:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:14554:x1872792608967936:12345-192.168.203.56@tcp:49:bash.0 00000100:00100000:2.0:1786034770.129228:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+18:14554:x1872792608967936:12345-192.168.203.56@tcp:49:bash.0 Request processed in 155us (12092us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034770.129262:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 12 00000100:00100000:1.0:1786034770.132708:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034770.133148:0:15468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608968320 00000100:00100000:2.0:1786034770.133158:0:15468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608968320 00000100:00100000:2.0:1786034770.133221:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 21 00000100:00100000:2.0:1786034770.133231:0:15468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dad3ced-da50-4764-ac1e-c77a2e771b85+6:14554:x1872792608968320:12345-192.168.203.56@tcp:101:bash.0 00010000:00010000:2.0:1786034770.133247:0:15468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786034770.133268:0:15468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cabb2791/0x490975051af412e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b83 expref: -99 pid: 15468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786034770.133293:0:15468:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a74ba50, atime: 0x6a74ba4d, ctime: 0x6a74ba50, blocks: 0x1 00010000:00010000:2.0:1786034770.133313:0:15468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=606s v=(0 0) 00010000:00010000:2.0:1786034770.133317:0:15468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786034770.133327:0:15468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cabb2791/0x490975051af412e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b83 expref: 7 pid: 15468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034770.133342:0:15468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cabb2791/0x490975051af412e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b83 expref: 7 pid: 15468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034770.133355:0:15468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964548aa7000, rc 0) 00000100:00100000:2.0:1786034770.133451:0:15468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:14554:x1872792608968320:12345-192.168.203.56@tcp:101:bash.0 Request processed in 221us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1786034770.133457:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 21 00000100:00100000:2.0:1786034770.136256:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 13 00000100:00100000:2.0:1786034770.136267:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+17:14555:x1872792608968192:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1786034770.137500:0:14359:0:(mdd_object.c:4291:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1786034770.137599:0:14359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00010000:00010000:2.0:1786034770.137634:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af412ef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034770.137648:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af412ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034770.137658:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af412ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034770.137667:0:14359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af412ef lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034770.137673:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af412ef lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034770.137679:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af412ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786034770.137737:0:14359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786034770.137807:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:14555:x1872792608968192:12345-192.168.203.56@tcp:35:lhsmtool_posix.0 Request processed in 1541us (20582us total) trans 8589934631 rc 0/0 00000100:00100000:2.0:1786034770.137813:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 13 00000020:00080000:2.0:1786034770.137817:0:14359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786034770.144249:0:15267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786034770.144263:0:15267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af412ef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.144273:0:15267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964548aa7400 already unused, calling callback (ffffffffc1761020) 00010000:00010000:3.0:1786034770.144278:0:15267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af412ef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.144288:0:15267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af412ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.144322:0:15267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96455a530b00) 00010000:00010000:3.0:1786034770.144324:0:15267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786034770.144329:0:15267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af412ef lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.144334:0:15267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964548aa7400/0x490975051af412ef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786034770.145569:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034770.145641:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608968576 00000100:00100000:3.0:1786034770.145649:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608968576 00000100:00100000:3.0:1786034770.145703:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 14 00000100:00100000:3.0:1786034770.145711:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+19:14554:x1872792608968576:12345-192.168.203.56@tcp:35:bash.0 00000001:00080000:3.0:1786034770.145985:0:14360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000001:00080000:3.0:1786034770.146198:0:14360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934633 00000100:00100000:3.0:1786034770.146298:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+22:14554:x1872792608968576:12345-192.168.203.56@tcp:35:bash.0 Request processed in 586us (731us total) trans 8589934634 rc 0/0 00000100:00100000:3.0:1786034770.146306:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 14 00000020:00080000:3.0:1786034770.146310:0:14360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1786034770.153538:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034770.153544:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786034770.153547:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786034770.269781:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034770.269930:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608968832 00000100:00100000:3.0:1786034770.269939:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608968832 00000100:00100000:3.0:1786034770.269998:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 61 00000100:00100000:3.0:1786034770.270009:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+22:14565:x1872792608968832:12345-192.168.203.56@tcp:101:lfs.0 00010000:00010000:3.0:1786034770.270031:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786034770.270050:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7319d0b5b758b8a expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786034770.270296:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1786034770.270482:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b8a expref: 24 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.270497:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96454a119300) 00010000:00010000:3.0:1786034770.270502:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786034770.270506:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af412f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.56@tcp remote: 0xe7319d0b5b758b8a expref: 24 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.270516:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964562312a00, rc 0) 00000100:00100000:3.0:1786034770.270578:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+23:14565:x1872792608968832:12345-192.168.203.56@tcp:101:lfs.0 Request processed in 570us (804us total) trans 8589934635 rc 301/301 00000100:00100000:3.0:1786034770.270585:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 61 00000100:00100000:1.0:1786034770.286414:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034770.286507:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608968960 00000100:00100000:3.0:1786034770.286529:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608968960 00000100:00100000:3.0:1786034770.286601:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 62 00000100:00100000:3.0:1786034770.286612:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+23:14565:x1872792608968960:12345-192.168.203.56@tcp:34:lfs.0 00010000:00010000:3.0:1786034770.286706:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41304 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.286727:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41304 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.286741:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41304 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.286757:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af4130b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.286765:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af4130b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.286792:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af4130b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287154:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af41312 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287164:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af41312 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287172:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af41312 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786034770.287229:0:14357:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af41312 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287245:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41304 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287252:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41304 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287260:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41304 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287266:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034770.287270:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41304 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287277:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41304 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287290:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96454a119500) 00010000:00010000:3.0:1786034770.287298:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034770.287304:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41304 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287311:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312a00/0x490975051af41304 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287324:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af4130b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287329:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af4130b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287335:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af4130b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287340:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562312600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034770.287342:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af4130b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287347:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af4130b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287353:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff96454a119100) 00010000:00010000:3.0:1786034770.287355:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034770.287358:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af4130b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287363:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562312600/0x490975051af4130b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287376:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af41312 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287387:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af41312 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287394:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af41312 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287399:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964562313000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1786034770.287402:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af41312 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287409:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af41312 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287417:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96454a119e00) 00010000:00010000:3.0:1786034770.287420:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786034770.287423:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af41312 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786034770.287429:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964562313000/0x490975051af41312 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786034770.287512:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+23:14565:x1872792608968960:12345-192.168.203.56@tcp:34:lfs.0 Request processed in 901us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034770.287522:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 62 00000100:00100000:1.0:1786034770.291194:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034770.291269:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608969216 00000100:00100000:3.0:1786034770.291280:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608969216 00000100:00100000:3.0:1786034770.291335:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00100000:3.0:1786034770.291346:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645412ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+23:14565:x1872792608969216:12345-192.168.203.56@tcp:35:lfs.0 00000100:00100000:2.0:1786034770.293691:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645412ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dad3ced-da50-4764-ac1e-c77a2e771b85+24:14565:x1872792608969216:12345-192.168.203.56@tcp:35:lfs.0 Request processed in 2330us (2497us total) trans 8589934636 rc 0/0 00000100:00100000:2.0:1786034770.293704:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 15 00000100:00100000:2.0:1786034770.992259:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff964574d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636220800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786034770.992331:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786034770.992558:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792636220800 00000100:00100000:0.0:1786034770.992566:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792636220800 00000100:00100000:0.0:1786034770.992625:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786034770.992633:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636220800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786034770.992667:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786034770.992720:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872792636220800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034770.992727:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1786034770.992811:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff964574d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872792636220800:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786034771.120221:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034771.812343:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034771.812385:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034771.812436:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034771.812456:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034771.812472:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034771.812487:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034771.812511:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034771.812534:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608969472 00000100:00100000:3.0:1786034771.812543:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608969472 00000100:00100000:3.0:1786034771.812585:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608969856 00000100:00100000:3.0:1786034771.812587:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608969856 00000100:00100000:3.0:1786034771.812628:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 39 00000100:00100000:3.0:1786034771.812638:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+24:2363:x1872792608969472:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034771.812706:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+24:2363:x1872792608969472:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 70us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034771.812714:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 39 00000100:00100000:3.0:1786034771.812731:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 40 00000100:00100000:3.0:1786034771.812738:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:2363:x1872792608969856:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034771.812764:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edfa1456-b35c-4b5b-9356-fefb374c3cea+6:2363:x1872792608969856:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034771.812769:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 40 00000100:00100000:3.0:1786034771.812798:0:15468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608969728 00000100:00100000:3.0:1786034771.812801:0:15468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608969728 00000100:00100000:3.0:1786034771.812818:0:15468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608969600 00000100:00100000:3.0:1786034771.812843:0:15468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608969600 00000100:00100000:3.0:1786034771.812859:0:15468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608969984 00000100:00100000:3.0:1786034771.812872:0:15468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608969984 00000100:00100000:3.0:1786034771.813168:0:15468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608970112 00000100:00100000:3.0:1786034771.813173:0:15468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608970112 00000100:00100000:3.0:1786034771.813205:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 26 00000100:00100000:3.0:1786034771.813211:0:15468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:2363:x1872792608969728:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:3.0:1786034771.813239:0:15468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:2363:x1872792608969728:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 29us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034771.813245:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 26 00000100:00100000:3.0:1786034771.813257:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:3.0:1786034771.813263:0:15468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dad3ced-da50-4764-ac1e-c77a2e771b85+5:2361:x1872792608969600:12345-192.168.203.56@tcp:9:kworker.0 00000020:00000080:3.0:1786034771.813280:0:15468:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af40fa0 00000100:00080000:3.0:1786034771.813295:0:15468:0:(import.c:65:import_set_state_nolock()) ffff964447bc7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786034771.813327:0:15468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1786034771.813631:0:15468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dad3ced-da50-4764-ac1e-c77a2e771b85+2:2361:x1872792608969600:12345-192.168.203.56@tcp:9:kworker.0 Request processed in 366us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034771.813639:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 22 00000100:00100000:3.0:1786034771.813653:0:15468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 23 00000100:00100000:3.0:1786034771.813660:0:15468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:2361:x1872792608969984:12345-192.168.203.56@tcp:9:kworker.0 00000020:00000080:3.0:1786034771.813671:0:15468:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af40fd8 00000100:00080000:3.0:1786034771.813676:0:15468:0:(import.c:65:import_set_state_nolock()) ffff964574ca0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786034771.813695:0:15468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1786034771.813764:0:15468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:edfa1456-b35c-4b5b-9356-fefb374c3cea+2:2361:x1872792608969984:12345-192.168.203.56@tcp:9:kworker.0 Request processed in 104us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1786034771.813770:0:15468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 23 00000100:00100000:1.0:1786034771.813886:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 24 00000100:00100000:1.0:1786034771.813905:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9645752f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+5:2361:x1872792608970112:12345-192.168.203.56@tcp:9:kworker.0 00000020:00000080:1.0:1786034771.813925:0:15041:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x490975051af40fdf 00000100:00080000:1.0:1786034771.813934:0:15041:0:(import.c:65:import_set_state_nolock()) ffff96444791e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786034771.813967:0:15041:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934597 00000100:00100000:1.0:1786034771.814071:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9645752f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:edfa1456-b35c-4b5b-9356-fefb374c3cea+2:2361:x1872792608970112:12345-192.168.203.56@tcp:9:kworker.0 Request processed in 168us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034771.814078:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 24 00010000:00010000:1.0:1786034771.814239:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786034771.814721:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786034771.814777:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608969344 00000100:00100000:0.0:1786034771.814791:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608969344 00000100:00100000:0.0:1786034771.814845:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 127 00000100:00100000:0.0:1786034771.814852:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964574778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:2363:x1872792608969344:12345-192.168.203.56@tcp:400:kworker.0 00000100:00100000:0.0:1786034771.814896:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964574778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9aa3392f-5dd2-4b3f-9ee0-d03730485c08+13:2363:x1872792608969344:12345-192.168.203.56@tcp:400:kworker.0 Request processed in 44us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1786034771.814903:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 127 00000100:00080000:0.0:1786034771.814927:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786034771.814931:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786034771.814934:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786034771.814939:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786034772.145079:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786034772.207320:0:16628:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1786034773.168130:0:15267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786034773.347131:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:3.0:1786034773.347182:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.56@tcp (source: 12345-192.168.203.56@tcp) 00000100:00100000:2.0:1786034773.347323:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608970240 00000100:00100000:2.0:1786034773.347332:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608970240 00002000:00100000:2.0:1786034773.347399:0:15044:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff964447032680 x1872792608970240/t0(0) o4->5dad3ced-da50-4764-ac1e-c77a2e771b85@192.168.203.56@tcp:744/0 lens 504/0 e 0 to 0 dl 1786034784 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1786034773.347411:0:15044:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964447032680 with x1872792608970240 ext(0->8) 00002000:00010000:2.0:1786034773.347417:0:15044:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff964447032680 00000100:00100000:2.0:1786034773.347441:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 0 00000100:00100000:2.0:1786034773.347450:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964447032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+7:2364:x1872792608970240:12345-192.168.203.56@tcp:4:bash.0 00000100:00100000:2.0:1786034773.347878:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964447032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5dad3ced-da50-4764-ac1e-c77a2e771b85+9:2364:x1872792608970240:12345-192.168.203.56@tcp:4:bash.0 Request processed in 428us (753us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1786034773.347887:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 0 00002000:00100000:2.0:1786034773.347895:0:15044:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff964447032680 x1872792608970240/t8589934598(0) o4->5dad3ced-da50-4764-ac1e-c77a2e771b85@192.168.203.56@tcp:744/0 lens 504/448 e 0 to 0 dl 1786034784 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1786034773.347904:0:15044:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff964447032680 with x1872792608970240 ext(0->8) 00002000:00010000:2.0:1786034773.347908:0:15044:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff964447032680 00000100:00100000:1.0:1786034773.348164:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872792608970368 00000100:00100000:1.0:1786034773.348178:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872792608970368 00000100:00100000:1.0:1786034773.348212:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.56@tcp, seq: 25 00000100:00100000:1.0:1786034773.348219:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964447031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+9:2364:x1872792608970368:12345-192.168.203.56@tcp:16:kworker.0 00000100:00080000:3.0:1786034773.348508:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786034773.427092:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964447031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dad3ced-da50-4764-ac1e-c77a2e771b85+9:2364:x1872792608970368:12345-192.168.203.56@tcp:16:kworker.0 Request processed in 78863us (79898us total) trans 0 rc 0/0 00000100:00100000:1.0:1786034773.427105:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.56@tcp, seq: 25 00000001:00080000:1.0:1786034773.427139:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00100000:1.0:1786034773.427150:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of edfa1456-b35c-4b5b-9356-fefb374c3cea 00000020:00000080:1.0:1786034773.427154:0:7682:0:(genops.c:906:class_export_put()) final put ffff96444791c800/edfa1456-b35c-4b5b-9356-fefb374c3cea 00000001:00080000:1.0:1786034773.427185:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1786034773.427193:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000020:00000080:1.0:1786034773.427208:0:10438:0:(genops.c:865:class_export_destroy()) destroying export ffff96444791c800/edfa1456-b35c-4b5b-9356-fefb374c3cea for lustre-OST0001 00000020:00000080:1.0:1786034773.427250:0:10438:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96444791e000 for lustre-OST0001 00000001:00100000:3.0:1786034774.188426:0:6746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of edfa1456-b35c-4b5b-9356-fefb374c3cea 00000020:00000080:3.0:1786034774.188438:0:6746:0:(genops.c:906:class_export_put()) final put ffff964574ca1800/edfa1456-b35c-4b5b-9356-fefb374c3cea 00000001:00100000:3.0:1786034774.188461:0:6746:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5dad3ced-da50-4764-ac1e-c77a2e771b85 00000020:00000080:3.0:1786034774.188464:0:6746:0:(genops.c:906:class_export_put()) final put ffff964447bc2800/5dad3ced-da50-4764-ac1e-c77a2e771b85 00000020:00000080:3.0:1786034774.188480:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff964574ca1800/edfa1456-b35c-4b5b-9356-fefb374c3cea for lustre-OST0000 00000020:00000080:3.0:1786034774.188530:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff964447bc2800/5dad3ced-da50-4764-ac1e-c77a2e771b85 for lustre-OST0000 00000020:00000080:3.0:1786034774.188544:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff964574ca0000 for lustre-OST0000 00000020:00000080:3.0:1786034774.188554:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff964447bc7000 for lustre-OST0000 00010000:00010000:0.0:1786034774.199332:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 31398 lines, 31398 kept, 0 dropped, 0 bad.